This wiki has no edits or logs made within the last 45 days, therefore it is marked as inactive. If you would like to prevent this wiki from being closed, please start showing signs of activity here. If there are no signs of this wiki being used within the next 15 days, this wiki may be closed per the Dormancy Policy. This wiki will then be eligible for adoption by another user. If not adopted and still inactive 135 days from now, this wiki will become eligible for deletion. Please be sure to familiarize yourself with Miraheze's Dormancy Policy. If you are a bureaucrat, you can go to Special:ManageWiki and uncheck "inactive" yourself. If you have any other questions or concerns, please don't hesitate to ask at Stewards' noticeboard.

Tools

From Open Data Scotland
Jump to navigation Jump to search

Data Formats[edit]

Common data formats are .csv, .json and .txt files.

Common, more exact, formats include: Turtle (.ttl) and CSV on the Web (.csvw).

Best Practice[edit]

For spreadsheets read Data Organization in Spreadsheets by Karl W. Broman & Kara H. Woo https://www.tandfonline.com/doi/full/10.1080/00031305.2017.1375989

Tools[edit]

Reading Data[edit]

Flatten Tool (json to csv) https://flatten-tool.readthedocs.io/en/latest/examples/

Google Sheets: App Script https://developers.google.com/apps-script and Google Query Language https://developers.google.com/chart/interactive/docs/querylanguage. And a library for version controlling: Clasp https://github.com/google/clasp

Microsoft Excel

Power Query is an Extract, Transform and Load (ETL) tool built in to Microsoft Excel (from 2016) and Microsoft's Power BI. It has a user interface which allows users to transform data without needing to code, although coding is possible in the "M" language. https://docs.microsoft.com/en-us/power-query/power-query-what-is-power-query

Mistakes and open/closed methodologies: Austerity spreadsheet mistake https://www.theatlantic.com/business/archive/2013/04/forget-excel-this-was-reinhart-and-rogoffs-biggest-mistake/275088/

Data Visualisation[edit]

Microsoft PowerBI

Tableau

R Shiny

D3.js