We, at DataGov are very interested in enabling datasets with API interfaces that will allow applications to dynamically use the data without downloading the entire dataset. What are some of the most popular ways that developers recommend and can you provide examples of use cases and/or existing apps that support this need?
The current Data.gov search tool is capable but cumbersome and does not yield desired results. We should combine and leverage capabilities in other government websites that have good search engines (and/or are planning on more improvements such as usa.gov). We should leverage and make this search available simply on the top of the site for all users. we should also have the ability to invoke more complex search capabilities ...more »
Though there is another idea regarding a wikipedia entry... I think it is important to have a separate wiki set up for developers as there are many developer topics where collaboration is key. Of course, there are tons of precedent for this whereby many major development efforts/sites have developer wikis.
In addition to posting datasets and web services, Agencies should also be posting code and documentation. As with a data policy of "By default, all data should be made available, unless there are compelling reasons why not, e.g. sensitivity" so to should be the case with GOTS code. A large number of parallel development efforts by contractors and agency staff alike are underway across many agencies, often replicating ...more »
As discussed in the CONOPS, semantic.data.gov will be an adjunct, experimental site to assist in the evolution of data.gov towards greater semantics. This site will also learn from lessons learned via data.gov.uk which is also exploiting semantic technologies. What would be the most important initial use cases the semantic web community would like to see semantic.data.gov tackle? Ontology development? Rule based alerts? ...more »
There should be a way to search for data that was created in 1997.
There should also be a way to search for only static data. Likewise there should be a way to filter by only data that is actively being updated or dynamic.
Allow to sort by realtime vs. static or batched data. Include more realtime feeds from science departments (satellite, geographic sensors, camera's, location data of assets, monitoring equipment). This allows the public to for instance write realtime monitoring applications for earthquakes, volcanic erruptions. Or process other data in realtime (like raw feeds from satelites, power stations, water quality, weather, ...more »
The current wikipedia Data.gov page is a great, open , neutral platform for the entire comunity to post the links to the latest global to local data.gov sites and the apps that have been generated by developers. It can become an authoritative reference for the growing open data community. Here is the link : http://en.wikipedia.org/wiki/Data.gov
All government agencies that provide data to the public should offer the data in standardized forms. This would include both the format (CSV, XML, SQL Server, Access, Oracle, etc.) and structure. For example, the State Energy Data System at EIA provides its annual data update in CSV, with columns for the variable name, location, date, and value. This would likely need to be modified for various applications, but if ...more »
Make sure the site is 508 accessible since its managed by GSA who are responsible for 508!
The cost of poor information is HUGE; over 50% of the Data warehouse projects fail due to poor information. There is no way any agency will provide quality information without producing quality database schemas. Very few agencies pay any attention to the quality of the schema and as a result, (a) development and maintenance costs skyrocket, (b) applications are delivered very late, (c) performance is not ideal and (d) ...more »
Currently users can rate the data usefulness etc but the rating isn't that meaningful because it isn't related to what the user is looking for. Adding an ability for users to tag datasets with keywords will make it easier for people to run more specific searches. And, if you allow users to associate ratings to keywords the rating system will deliver much richer information.
I am a consultant that often works with a lot of government entities and it would be nice to have a web service to call to retrieve the datasets and display in our systems.
Like many commercial product catalogs (i.e. Amazon.com) there is a web services api to search/access the catalog. Of course there are also REST APIs to do this (don't want a REST versus web services flame war here).
What catalog API would developers suggest for data.gov?
Is there a standard catalog API suitable for data.gov?
Discuss via your comments...
As data on Data.Gov becomes more robust and use increases tools that operate on identified raw data sets will increase. Different users may find greater utility or data aggregated into tool sets. Providing both options wherever possible is a solution that can best meet the broadest needs of potential Data.Gov users. Providing a mechanism for submitting tools that operate on the data rather than containing the data ...more »
Recently I saw your documentary on the History..or Discovery channel outlining your plans for the Constellation Misson/Project. You stated that you could not land in a favorable and safe site due to the fact that you would only be able to uses solar panels during daylight periods. So you are landing in a dangerous site in order to have sunlight 24/7. This would seem to me that you are baseing the entire success of the ...more »
When the desktop platforms for developers are locked down to the extent that the developers cannot explore new technologies and new solution approaches, creativity is stifled. There are a large number of solutions in the Federal government that were realized because developers were allowed to experiment with varying technologies. It is important that developers be enabled.
The New Markets Tax Credit program supports Low-Income Community development. The CDFI Fund, who administers the program puts out a monthly "QEI Investment Report". This is a very useful report, and contains a lot of great information. The issue is that it is distributed in PDF format. This is fine for those who read it, but if you want to run any kind of analytics on the data, it must be first be extracted from ...more »
Can the data be standardized/harmonized using something like SDMX (Statistical Data and Metadata eXchange http://www.sdmx.org)
We currently manually download the Foreign Per Diem rates posted in excel on this website each month: http://aoprals.state.gov/content.asp?content_id=233&menu_id=89
We import this data into our local travel expense database so we have to keep it up-to-date. If this data was posted in XML format, we believe we can automate the download/upload process that we're doing manually.
Building a UI of the government from the top down, which is multimedia (Adobe Flash) so the public can visually see how all the agencies connect and who they report too? From the top down so users can view the highest of government, down to the city they live in. All data could be connected to the agency it pertains to, and its representatives, with picture and years in office.
Example: A Family Tree
Demonstrate technical examples which show how to integrate legacy systems (most common in state and local government agencies) into the federal data aggregation system, to speed adoption. Many state and local agencies rely on disparate technologies for collecting and reporting data. Over the years, proprietary and deprecated systems have become the norm in some agencies as a result of IT or procurement policy. There ...more »
la operacion financiera de los bancos sea auditada desde el punto de vista de la gestion de la calidad como soporte de la auditoria contable ,esto atrae mas empleos . para los ingenieros de este actividad . "The financial operations of banks should be audited based on their quality perspective as well as their accounting principles, this type of effort generates more employment, especially for the engineers involved ...more »
Why not create a forum where the citizens have a place to discuss topics that impact us all and maybe the government will monitor to help try and follow the sway of the people and not just the sway of those with the most money? I would like to see a discussion on such topics as: 1) Government collects 450+ million in Social Security Tax each year but only spends roughly 145 million on Social Security any yet its ...more »