blog authors
past blog entries

Welcome to the Kellylab blog

geospatial matters

Please read the UC Berkeley Computer Use Policy. Only members can post comments on this blog.

Entries in open source (55)

Wednesday
Jan302013

Mapping and interactive projections with D3

D3 is a javascript library that brings data to life through an unending array of vizualizations.  Whether you've realized it or not, D3 has been driving many of the most compeling data visualizations that you have likely seen throughout the last year including a popular series of election tracking tools in the New York Times.

You can find a series of examples in D3's gallery that will keep you busy for hours!

In addition to the fantastic charting tools, D3 also enables a growing list of mapping capabilities.  It is really exciting to see where all this is heading.  D3's developers have been spending a lot of time most recently working on projections transformations.  Check out these amazing interactive projection examples:

Projection Transitions

Comparing Map Projections

Adaptive Composite Map Projections (be sure to use chrome for the text to display correctly)

Can't wait to see what the future has in store for bringng custom map projections to life in more web map applications!

 

Monday
Nov192012

Introduction to the Web-enabled Landsat Data (WELD) products using open source software

Introduction to the Web-enabled Landsat Data (WELD) products using open source software

At American Geophysical Union Fall 2012 Meeting, San Francisco December 6, 2012
______________________________

The NASA funded Web-enabled Landsat Data (WELD) project is providing near-continental scale 30m Landsat time series products (http://weld.cr.usgs.gov).

This 4.5 hour training workshop will provide student and expert users with tips and techniques to handle the WELD products.

Participants will bring their own laptops and a Linux-like Virtual Machine will be installed with remote sensing and GIS open source software, sample WELD products, scripts, and example exercises that illustrate a variety of WELD environmental monitoring and assessment applications. Participants will be assisted through the example exercises and all training material will be available for their later consultation. New WELD product versions will be available and participant feedback and suggestions to evolve the WELD processing
algorithms, product contents and format will be sought.
More information at http://globalmonitoring.sdstate.edu/projects/weld/weldtraining.html

Cost: Free (No AGU Registration Fee Needed)
Date: December 6, 2012
Time: 6:00pm - 10:30pm
Location: San Francisco Marriott
Room: Sierra A

Tuesday
Oct022012

CartoDB launches tools for visualizing temporal data

CartoDB, a robust and easy to use web mapping application, today launched "torque" a new feature enabling visualization of temporal data sets. 

From the CartoDB team:

Torque is a library for CartoDB that allows you to create beautiful visualizations with temporal datasets by bundling HTML5 browser rendering technologies with an efficient data transfer format using the CartoDB API. You can see an example of Torque in action on the Guardian's Data Blog, and grab the open source code from here.

Be sure to check out the example based on location data recorded from Captain's logs from the British Royal Navy during the first World War.  Amazing stuff!

 

Monday
Jul232012

New open datasets for City of Oakland and Alameda County

Following on the footsteps of the county and city of San Francisco open data repository at data.sfgov.org, two new beta open data repositories have recently been released for the City of Oakland and Alameda County. This development coincides with the recent 2012 Code for Oakland hackathon last week. The hackathon aims to make government more transparent in the city and county through the use of technology with apps and the web to make public access to government data easier. The City of Oakland’s open data repository at data.openoakland.org includes data on crime reports for a variety of spatial scales, a variety of tabular and geographic data such as parcels, roads, trees, public infrastructure, and locations of new development to name a few. It is important to note that the Oakland open data repository is currently not officially run or maintained by the City of Oakland. It is currently maintained by members of the community and the OpenOakland Brigade. Alameda County’s open data repository at data.acgov.org includes data on Sherriff crime reports, restaurant health reports, solar generation data, and a variety of tabular and geographic data and public health department data. Data can be viewed on a browser as an interactive table or an interactive map or the data can be downloaded in a variety of formats. Both sites are still in their infancy so expect more datasets to come online soon. Also on the same note, the Urban Strategies Council recently released a new version of their InfoAlamedaCounty webGIS data visualization and map viewer - check it out.

 Screenshot of City of Oakland Open Data: data.openoakland.org

Screenshot of Alameda County Open Data: data.acgov.org

Friday
Jun222012

New ArcGIS and QGIS desktop versions available

Big updates are now available to both ArcGIS and QGIS bringing more power and functionality to desktop GIS users!

ArcGIS 10.1 is now available with lots of new features.  Learn more from ESRI.com.  The GIF is now testing the updated software and we plan to make it available on lab workstations in the coming weeks.

QGIS 1.8 is also now available, and is free for download.  Visit QGIS.org for download instructions and to learn more about the new features available in this release.

Saturday
Mar242012

ASPRS 2012 Wrap-up

ASPRS 2012, held in Sacramento California, had about 1,100 participants. I am back to being bullish about our organization, as I now recognize that ASPRS is the only place in geospatial sciences where members of government, industry, and academia can meet, discuss, and network in a meaningful way. I saw a number of great talks, met with some energetic and informative industry reps, and got to catch up with old friends. Some highlights: Wednesday's Keynote speaker was David Thau from Google Earth Engine whose talk "Terapixels for Everyone" was designed to showcase the ways in which the public's awareness of imagery, and their ability to interact with geospatial data, are increasing. He calls this phenomena (and GEE plays a big role here): "geo-literacy for all", and discussed new technologies for data/imagery acquisition, processing, and dissemination to a broad public(s) that can include policy makers, land managers, and scientists. USGS's Ken Hudnut was Thursday's Keynote, and he had a sobering message about California earthquakes, and the need (and use) of geospatial intelligence in disaster preparedness.

Berkeley was well represented: Kevin and Brian from the GIF gave a great workshop on open source web, Kevin presented new developments in cal-adapt, Lisa and Iryna presented chapters from their respective dissertations, both relating to wetlands, and our SNAMP lidar session with Sam, Marek, and Feng (with Wenkai and Jacob from UCMerced) was just great!

So, what is in the future for remote sensing/geospatial analysis as told at ASPRS 2012? Here are some highlights:

  • Cloud computing, massive datasets, data/imagery fusion are everywhere, but principles in basic photogrammetry should still comes into play;
  • We saw neat examples of scientific visualization, including smooth rendering across scales, fast transformations, and immersive web;
  • Evolving, scaleable algorithms for regional or global classification and/or change detection; for real-time results rendering with interactive (on-the-fly) algorithm parameter adjustment; and often involving open source, machine learning;
  • Geospatial data and analysis are heavily, but inconsistently, deployed throughout the US for disaster response;
  • Landsat 8 goes up in January (party anyone?) and USGS/NASA are looking for other novel parterships to extend the Landsat lifespan beyond that;
  • Lidar is still big: with new deployable and cheaper sensors like FLASH lidar on the one hand, and increasing point density on the other;
  • Obia, obia, obia! We organized a nice series of obia talks, and saw some great presentations on accuracy, lidar+optical fusion, object movements; but thorny issues about segmentation accuracy and object ontology remain; 
  • Public interaction with imagery and data are critical. The Public can be a broader scientific community, or a an informed and engaged community who can presumably use these types of data to support public policy engagement, disaster preparedness and response.
Wednesday
Feb292012

New OSGeo-Live GIS software collection released

OSGeo-Live is a self-contained bootable DVD, USB flash drive and Virtual Machine based upon Ubuntu Linux that is pre-configured with a wide variety of robust open source geospatial software. The applications can be trialled without installing anything on your computer, simply by booting the computer from the DVD or USB drive. The lightening overview introduces all these applications, and hence provides a comprehensive introduction to the breadth of Geospatial Open Source.

http://live.osgeo.org

Highlights
50 Quality Geospatial Open Source applications installed and pre-configured
Quality free world maps and geodata
One page overviews and quick start guides for all applications
Overviews of key OGC standards
Translations for Greek, German, Polish, Spanish and Japanese

Contents

Browser Clients

  • OpenLayers - Browser GIS Client
  • Geomajas - Browser GIS Client
  • Mapbender - Geoportal Framework
  • MapFish - Web Mapping Framework
  • GeoMoose - Web GIS Portal

Crisis Management

  • Sahana Eden - Disaster management
  • Ushahidi - Mapping and Timeline for events

Databases

  • PostGIS - Spatial Database
  • SpatiaLite - Lightweight Database
  • Rasdaman - Multi-Dimensional Raster Database
  • pgRouting - Routing for PostGIS


Desktop GIS

  • Quantum GIS (QGIS)
  • GRASS GIS
  • gvSIG Desktop
  • User-friendly Desktop Internet GIS (uDig)
  • Kosmo Desktop
  • OpenJUMP GIS
  • SAGA
  • OSSIM - Image Processing
  • Geopublisher - Catalogue
  • AtlasStyler - Style Editor
  • osgEarth - 3D Terrain Rendering
  • MB-System - Sea Floor Mapping

Navigation and Maps

  • GpsDrive - GPS Navigation
  • Marble - Spinning Globe
  • OpenCPN - Marine GPS Chartplotter
  • OpenStreetMap - OpenStreetMap Tools
  • Prune - View, Edit and Convert GPS Tracks
  • Viking - GPS Data Analysis and Viewer
  • zyGrib - Weather Forecast Maps


Spatial Tools

  • GeoKettle - ETL (Extract, Transform and Load) Tool
  • GDAL/OGR - Geospatial Data Translation Tools
  • GMT - Cartographic Rendering
  • Mapnik - Cartographic Rendering
  • MapTiler - Create Map Tiles
  • OTB - Image Processing
  • R Spatial Task View - Statistical Programming


Web Services

  • GeoServer
  • MapServer
  • deegree
  • GeoNetwork - Metadata Catalogue
  • pycsw - Metadata Catalogue
  • MapProxy - Proxy WMS & tile services
  • QGIS Server - Web Map Service
  • 52°North WSS - Web Security Service
  • 52°North WPS - Web Processing Service
  • 52°North SOS - Sensor Observation Service
  • TinyOWS - WFS-T Service
  • ZOO Project - Web Processing Service


Data

  • Natural Earth - Geographic Data Sets
  • OSGeo North Carolina, USA Educational dataset
  • OpenStreetMap - Sample extract from OpenStreetMap


Geospatial Libraries

  • GeoTools - Java GIS Toolkit
  • MetaCRS - Coordinate Reference System Transformations
  • libLAS - LiDAR Data Access


Other software of interest (not available Live)

  • MapWindow GIS - Microsoft Windows based GIS
  • MapGuide Open Source - Web Service
Thursday
Jan192012

troubling report of OSM vandalism

From Sarah. This is a troubling story from ReadWriteWeb reporting that someone at a range of Google IP addresses in India has been editing the collaboratively made map of the world in some very unhelpful ways, like moving and deleting information and reversing the direction of one-way streets on the map.

Update: Google sent the following statement to ReadWriteWeb on Tuesday morning. "The two people who made these changes were contractors acting on their own behalf while on the Google network. They are no longer working on Google projects."

A Google spokesperson told BoingBoing on Friday that the company was "mortified" by the discovery - but now it appears the same Google contractor may be behind mayhem rippling throughout one of the world's biggest maps. Google says it's investigating these latest allegations.

Thursday
Sep082011

MIT releases new Urban Network Analysis Tool for ArcGIS 10

The MIT City Form Research Group recently released a new open-source plugin for ArcGIS 10 to perform advanced spatial analyses on network data such as urban street networks. The tool can give researchers a better understanding of how the spatial layout of cities and their social, economic, and environmental processes affect the way people live in it.

The tool measures reach, gravity, betweenness, closeness, and straightness on spatial networks. This means you can assess the number of services or resources within a certain walking distance and can analyze the volume of traffic along sidewalks and streets. Like other network analysis tools, the tool evaluates network element geometry and distance and distinguishes between shorter and longer links. What is unique about this tool is that it not only operates with node and edge elements like other network analysis tools, but it can also incorporate additional network elements such as buildings. Individual buildings or objects can be characterized within spatial networks and can be weighted to give more or less influence. For example, more populated buildings can be set to have a greater impact on results. The tool can also be used to assess urban growth and change.

Click here for the press release.

Wednesday
Dec222010

Open Street Map's further integration into commercial mapping products

MapQuest has recently announced the opening of a secondary beta open source mapping website based on the Open Street Maps engine where community members can post and edit map data that will then be integrated into Open Street Maps and MapQuest products. The announcement also indicates MapQuest may in the near future merge this beta open source map portal with their commercial map portal. The integration of community based map editing and open source data in commercial products has started to become a trend in the commercial mapping world. Other commercial map products such as Microsoft Bing and commercial mapping applications such as ESRI ArcGIS 10 base maps already offer Open Street Map as a product to view alongside their propriety map data. Community led commercial map editing is not entirely new as Google and other map services already allow account members to point out errors and make corrections. What is different in the case of MapQuest is the integration of open source data with commercial data. This continues to push the boundaries of community led mapping and the further proliferation of open source data products in the commercial and public spheres.

Read the full article here.

Open MapQuest Beta