• Amazon Web Services
• Apache Mahout
  TLP project to create scalable, machine learning algorithms. Mahout has many links to get free and paid corpus data.
• AWS (Amazon Web Services) Public Data
  provides a centralized repository of public data sets that can into AWS cloud-based applications.
• BDR
  - Big Data Repository
• big list of public data sources.
• Bioassay data
  described in Virtual screening of bioassay data, by Amanda , J. of , with 21 Bioassay datasets (Active / Inactive compounds) available for download.
• Bitly 1usagov data
  anonymized clicks on gov links.
• Bureau of Justice
  Here you can find data on law enforcement agencies, jails, and probation agencies and courts.
• Canada Open Data
  project with and geospatial datasets.
• Causality Workbench
  data repository.
• GeodaCenter
  geographical and spatial data.
• CERN Open Data
  More than one petabyte of data from particle physics experiments carried out by CERN.
• Common crawl
  builds and maintains an open crawl of the web accessible to everyone. in amazon s3bucket and the requester may some money to access it.
• Complete Public Reddit Comments Corpus
  Over one billion public comments posted to Reddit between 2007 and 2015, for training language algorithms
• Corral Big Data repository
  at Texas Advanced Computing Center, supporting data-centric science.
• Data Dumps
  Datasets on books including catalogs from libraries around the world
• Data Market
  Offers a free package with access to datasets covering world population, currencies, development indicators and weather data.
• Data Source Handbook
  A Guide to Public Data, by , O’Reilly (Jan 2011).
• DataCatalog.org
  open government data from US, EU, Canada, CKAN, and more.
• Datagov
• Datagovuk
  publicly available data from UK (also London .)
• Datagov/Education
  central guide for education data resources including high-value data sets, data visualization tools, resources for the classroom, applications created from open data and more.
• DataMarket
  visualize the world’s economy, societies, nature, and industries, with million time series UN, World Bank, Eurostat and other important data providers.
• Datasets
  comprehensive data on random 10,000 UK companies sampled from , updated automatically using AI/Machine Learning.
• dataworld
  is a platform where data scientists can find and use a vast array of high-quality open data, collaborate on data projects, and meet other like-minded data nerds.
• DMOZ
  - Open Directory Project is the largest, most comprehensive human-edited directory of the Web. It has collections of URLs in . is one main source for internet search engines.
• eBay Market Data Insights
  Data on millions of online sales and auctions from eBay
• EDRM File Formats Data
  of 381 files covering 200 file formats. EDRM Enron Email Data Set v2 Enron e-mail messages and attachments in two sets of downloadable compressed files: XML and PST.
• Enron Email
  data from about 150 users, mostly senior management of Enron.
• European Union Open Data Portal
• Europeana Data
  contains open metadata on 20 million texts, images, videos and sounds gathered by Europeana – the trusted resource for European cultural heritage content.
• Facebook Graph
• FBI Uniform Crime Reporting
  The FBI and publishing national crime statistics, with free data available at , state and county level.
• FEDSTATS
  a comprehensive source of US statistics and more
• FIMI repository for frequent mining
  implementations and datasets.
• Financial Times Market Data
  information on financial markets from around the world, including stock price indexes, commodities and foreign exchange.
• FiveThirtyEight
  polls data on public opinion of political and sporting issues.
• Socrata
  access to over 10,000 datasets including business, education, government, and fun.
• GDELT
  The Global Data on Events, Location and Tone, described by Guardian as “a big data history of life, the universe and everything.”
• GEO (GEO Gene Expression Omnibus)
  a gene expression/molecular abundance repository supporting MIAME compliant data a curated, online resource for gene expression data browsing, query and retrieval.
• Glassdoor API
  Information about job vacancies, candidates, salaries and employee satisfaction is available through their developer API.
• Google Books
  text from millions of books scanned by Google.
• Google datasets
  to find datasets
• Google Finance
• Google Scholar
  Entire texts of academic papers, journals, books and legal case law.
• Google Trends
  Examine and analyze data on search activity and trending news stories around the world.
• Grain
  financial data including stocks, futures, etc.
• Hilary Mason research-quality Big Data sets collection
  - and image datasets.
• ICWSM-2009 dataset
  contains 44 million blog posts made between August 1st and October 1st, 2008.
• IMDB Datasets
  Datasets in formats drawn from the web’s largest resource on movies, and people working in those industries.
• IMF Data
  The International Monetary Fund publishes data on international finances, debt rates, foreign exchange reserves, commodity prices and investments.
• Instagram
  As with Twitter, Instagram posts and conversations are public by default. Their APIs allow likes, and business details to .
• Irish Electric Vehicle Charge Point Status
  Collates data from the which oversees the network of EV charge points across the Republic of Ireland and Northern Ireland.
• Jerry Smith dataset collection
  with Finance, Government, Machine Learning, Science, and other data.
• KONECT
  the Koblenz Network Collection, with large network datasets of all types  to perform research in  network mining.
• Labelled Faces in the Wild
  13,000 collated and labeled images of human faces, for  developing applications involving facial recognition.
• Linking Open Data
  at making data freely available to everyone.
• list of SNA datasets
  for text, SNA, and other fields.
• Machine Learning Dataset Repository 
  Kaggle Collection of open datasets contributed by data scientists involved in machine learning projects.
• Microsoft Azure Data Markets Free Datasets
  Freely available datasets covering everything from agriculture to weather
• Microsoft Marco
  Microsoft’s open machine learning datasets for training systems in reading comprehension and question answering.
• Million song data
  has data related to tracks and songs.
• Million Song Data Set
• ML Data
  the data repository of the EU Pascal2 networks.
• NASA Exoplanet Archive
  Public datasets covering planets and stars gathered by NASA’s space exploration missions.
• NASDAQ Data
  provides access to market data.
• National Climatic Data Center
• National Government Statistical Web Sites
  data, reports, statistical yearbooks, press releases, and more from about 70 web sites, including countries from Africa, Europe, Asia, and Latin America.
• National Space Science Data Center (NSSDC)
  NASA data sets from planetary exploration, space and solar physics, life sciences, astrophysics, and more.
• Natural History Museum Data Portal
  Information on nearly 4 million historical specimens in the London museum’s collection, scientific sound recordings of the natural world.
• New York Times
• NHS Health and Social Care Information Centre
• One Million Audio Cover Images
  Dataset hosted at archiveorg covering music released around the world, for  image processing research
• Open Data
  assesses the state of open data around the world.
• Open Source Sports
  many sports databases, including Baseball, Football, Basketball, and Hockey.
• OpenCorporates
  The world’s largest open database of companies.
• datasf.org
  a clearinghouse of datasets available from the City & County of San Francisco, CA.
• Project Gutenberg
  offers over 36,000 free ebooks to download to your PC, Kindle, Android, or other portable device.
• Quandl
  a collaboratively curated portal to millions of financial and economic time-series datasets.
• qunb
  a platform to find and visualize quantitative data.
• Robert Schiller data
  on housing, stock market, and more from his book Irrational Exuberance.
• SourceForgenet Research
  includes historic and status statistics on approximately 100,000 projects and over 1 million registered users’ activities at the project management.
• The CIA World Factbook
• The UK Data Centre
  The UK’s largest collection of social, economic and population data.
• The US National Center for Education Statistics
  Data on educational institutions and education demographics from the US and around the world.
• THEINFO
  This is a site for large data sets and the people who love them: the scrapers and crawlers who collect them, the academics and geeks who process them, the designers and artists who visualize them. It’s a place where they can exchange tips and tricks, develop and share tools together, and  integrate their particular projects.

Anterior

Siguiente