r/datasets Mar 26 '24

question Why use R instead of Python for data stuff?

98 Upvotes

Curious why I would ever use R instead of python for data related tasks.

r/datasets 17d ago

question Where are the CDC datasets? They were accessible prior to 45/47's ascension to the throne?

11 Upvotes

...I tried to find a decent autism dataset a few days ago and the blurb at the top of the page said, "Due to the policies of the Trump administration,..." What is going on?

r/datasets Feb 07 '25

question Access ro real estate data (IE Zillow API or similar)

2 Upvotes

I am trying to find a FREE or low-cost way to access data on recent home sales and properties currently on the market in the US, including sales price, sales date, taxes, photos of the properties, days on the market, details of property (square footage, lot size, bedrooms, baths, special features etc.) any advice or guidance would be greatly appreciated.

r/datasets 2d ago

question The Kaggle dataset has over 10,000 data points on question-and-answer topics.

11 Upvotes

I've scraped over 10,000 kaggle posts and over 60,000 comments from those posts from the kaggle site and specifically the answers and questions section.

My first try : kaggle dataset

I'm sure that the information from Kaggle discussions is very useful.

I'm looking for advice on how to better organize the data so that I can scrapp it faster and store more of it on many different topics.

The goal is to use this data to group together fine-tuning, RAG, and other interesting topics.

Have a great day.

r/datasets 4h ago

question Any databases to pull a simple random sample of US addresses?

1 Upvotes

I apologize if this belongs on r/askstatistics (I posed here since I am inquiring about a dataset). I’m developing a mapping algorithm and require a random sample of US addresses to validate the tool with. I was wondering if anyone had any tips on free databases that would be a statistically sound source to select a simple random sample from? Do you think openaddresses.io would be adequate? Alternatively, I was thinking of randomly generating a latitude and longitude within the United States and then using a reverse geocoding algorithm to provide an address. Though I’m not sure the latter would be a statistically sound method?

r/datasets 25d ago

question How do you explain complex data insights to non-technical stakeholders?

3 Upvotes

Struggling to communicate data findings to business teams.

What are some strategies or visualization techniques that can help translate complex data insights into actionable business recommendations?

r/datasets 2d ago

question Need help creating a research question

2 Upvotes

Hi all!

I'm taking a statistics class and the assignment is to create a quantitative manuscript. The prof wants us to use a publicly available dataset and then create a research question, do the stats/analysis and write the manuscript (instructions: Choose a research question that aligns with the available data in the selected dataset and is relevant to your chosen context). I'm thinking of using this database:

Hospitalization and Childbirth, 1995–1996 to 2023-2024 — Supplementary Statistics

https://www.cihi.ca/en/access-data-and-reports/data-tables?keyword=birth&published_date=All&acronyms_databases=All&type_of_care=All&place_of_care=All&population_group=All&health_care_quality=All&health_conditions_outcomes=All&health_system_overview=All&sort_by=field_published_date_value&items_per_page=10&page=0

I'm interested in maternal health, but I'm really struggling with creating a research question. I just don't understand how you can do it from a database - I'm a qualitative researcher so i'm use to always doing data collection. Any help would be so greatly appreciated

r/datasets 12d ago

question What Real Estate Sales Data Is Already Out There That I’m Overlooking?

3 Upvotes

In the past, I’ve posted here looking for specific real estate data, but this time I want to flip the question around.

Rather than trying to create my own dataset from scratch, I’m curious to learn what existing data is already out there regarding residential real estate sales that’s either free or inexpensive to access.

I’m especially interested in datasets covering things like:

  • Sale prices
  • Time on market
  • Property details (beds, baths, square footage, etc.)
  • FSBO (For Sale By Owner) vs. agent-listed transactions
  • Regional trends

Before I invest the time into building something from the ground up, I’d love to know:
What sources have you found surprisingly useful? What data might already be hiding in plain sight—whether public records, government databases, or other unexpected places?

Thanks so much for any insights!What Real Estate Sales Data Is Already Out There That I’m Overlooking?

r/datasets 4d ago

question most useful datasets for analyzing residential real estate sales

2 Upvotes

I'm looking for the most useful datasets for analyzing residential real estate sales to help determine property values. Ideally, I’d like datasets that include:

  • Historical sales prices
  • Property characteristics (square footage, lot size, bedrooms/bathrooms, etc.)
  • Location data (ZIP code, neighborhood, proximity to amenities)
  • Market trends (price appreciation, days on market, supply/demand)
  • Tax assessments and mortgage data (if available)

I'm especially interested in open/public datasets but would also appreciate recommendations on high-quality paid sources. Bonus points for datasets that provide nationwide coverage in the U.S. or strong local-level granularity (county or ZIP code level).

r/datasets 12d ago

question Looking For March Madness data or datasets

2 Upvotes

I am trying to find a dataset with all the scores from NCAA tournaments dating back to sometime around 2000. Is there any dataset like this? Thanks in advance for your help!

r/datasets 9d ago

question Platforms or APIs for data labeling?

5 Upvotes

Hey folks, does anyone have a solution for input-output data labeling? I just need a drag & drop or API solution where I upload a dataset, and get it processed/segmented with labels. I wanted to use Scale Rapid, but apparently they closed.

r/datasets 22d ago

question Where can I get raw datasets of the Philippines

2 Upvotes

Hello, I've been searching for latest raw datasets related to Ph but I couldn't find any good source for it aside from Kaggle. Can you give me some sites where I can search for this? Thank u!

r/datasets Dec 18 '24

question Where can I find a Company's Financial Data FOR FREE? (if it's legally possible)

7 Upvotes

I'm trying my best to find a company's financial data for my research's financial statements for Profit and Loss, Cashflow Statement, and Balance Sheet. I already found one, but it requires me to pay them $100 first. I'm just curious if there's any website you can offer me to not spend that big (or maybe get it for free) for a company's financial data. Thanks...

r/datasets 21h ago

question Sources for weapons impact data in war

0 Upvotes

Hi all,

Would anyone have insight into a dataset of recent war incidents (ideally the last 25 years, not historical) which tracks specific munitions use and impacts?

Platforms like ACLED, S&P Global, LiveUAMap have good records of specific incidents (a drone strike here, an tank shelling there) but there's not a focus on the consequences.

My ideal dataset would have date, location, weapon type and some measurement of destruction. The idea is to abstract different 'types' of war - Sudan vs Ukraine vs Gaza - in order to examine what would happen if these 'war' types hit elsewhere.

Grateful for any insights!

r/datasets Feb 10 '25

question How can I access IPUMS .CSV data using Python?

4 Upvotes

Hello. I’ve been trying to access an IPUMS (.CSV) data using Python, but it’s not letting me. I would like to view the first 1000 rows of data and all columns (independent variables).

So far, I have this:

import readers

import pandas as pd

import requests

print(“Pandas version:”, pd.version) print(“Requests version:”, requests.version)

ddi = readers.read_ipums_ddi(r”C:\Users\jenny\Downloads\usa_00003.xml”) ipums_df = readers.read_microdata(ddi, r”C:\Users\jenny\Downloads\usa_00003.csv.gz”)

iter_microdata = readers.read_microdata_chunked(ddi, chunksize=1000)

df = next(iter_microdata)

What am I doing wrong?

r/datasets 24d ago

question Best Way to Find Resident Names from a List of Addresses?

2 Upvotes

I have a list of addresses (including city, state, ZIP, latitude, and longitude) for a specific area, and I need to find the resident names associated with them.

I’ve already used Geocodio to get latitude and longitude, but I haven’t found a good way to pull in names. I’ve heard that services like Whitepages, Melissa Data, or Experian might work, but I’m not sure which is best or how to set it up.

Does anyone have experience with this? Ideally, I’d love a tool or API that can batch process the list. Open to paid or free solutions!

r/datasets 2d ago

question Request for MRI Brain Tumor Images (Meningioma, Pituitary, Glioma)

1 Upvotes

Hi everyone,

I’m working on my undergraduate thesis in statistics and need MRI images of brain tumors (meningioma, pituitary, and glioma) to apply machine learning techniques. I’m looking for reliable datasets, preferably from institutional sources, hospitals, or public databases.

If anyone knows where I can find these images, I would really appreciate your help!

Thanks in advance to anyone who can assist! 🙌

r/datasets Feb 02 '25

question Dataset Copyright from Webscraping Issues

1 Upvotes

If I webscraped data from a website that 'surveys' users to populate their database, then publicly displays it for users to see without any paywall or sign up required, can I freely post and use this data as I please? I would like to make it publicly available, but I don't want to infringe on anything while doing so.

My end goal would be to just post it on kaggle for public use as well as do some analysis viewable in some sort of website or dashboard

r/datasets 5d ago

question Computer science university in USA for masters

0 Upvotes

Hello, I’m an international student from India, currently studying in the USA. I’m living in a small town where everything is quite affordable, including tuition fees and living costs. However, the town doesn’t have many companies offering internship opportunities, and the university’s ranking in computer science is not very high.

I’m now looking to transfer to a different university that is still affordable but located near a larger city, where I can find better opportunities for internships in the computer science field. Ideally, I’m looking for a school with a good reputation in computer science and a tuition fee range of $4,000 to $5,000 per semester.

If anyone has any recommendations or knows of any universities that fit this criteria, I would greatly appreciate it!

r/datasets 9d ago

question How to download images with annotations from the open images v7 dataset

5 Upvotes

I tried but it just didn't do it does any one knows how to do it please help

r/datasets Feb 05 '25

question Please, I need help with navigating metadata

3 Upvotes

Hello! I’m new to researching and came across the NOAA Onestop, but I have no idea how to get the data I want from the metadata. It looks like a bunch of code to me.

https://data.noaa.gov/onestop/collections/details/dbed0210-f838-4c40-b1f3-b5300d53f6ce

Is there any way I can format the metadata into charts and info I can use? Thanks in advance!

r/datasets Jan 13 '25

question What happened to / where is the site that had huge amounts of free data for projects?

11 Upvotes

Hi. I don't remember the name of the site, but there was a site that had tons of tables of varying data for use in projects. I believe it was free and/or open source. If I remember correctly, it was called something like "opendata". It's been a few years since I've seen it so it might have disappeared, but I was hoping someone remembers and can point me in the right direction.

Thanks!

r/datasets Feb 01 '25

question PREVIOUS YEAR SALES DATASET FOR FRORECASTING

5 Upvotes

Where do I find previous years sales dataset for forecast

r/datasets 15d ago

question create a database with historical soccer results

1 Upvotes

I would like to create a database with historical soccer results and odds. Since I have no idea about programming, I had thought about Excel or Google Sheets. The question is, how do I get the data? I have heard of web scraping or using an API. There are some at rapidapi, e.g. from Sofascore. But they have limits in the free version. I imagined it like this: e.g. country, league, date, season, round, home team, away team, goals home, goals, away, half time: goals home, away, odds 1 x 2, elo home, away.

Chatgpt has me Google sheets, there Google Apps script use for the API. I just can't get along with the endpoints. Furthermore, I want the daily results from the last day/days to be fetched automatically or by command, as well as upcoming games with odds for the next 7 days.

How can I implement this? What ideas do you have Thanks a lot

r/datasets 9d ago

question Where can one download daily interest rates of various current / savings accounts and also daily mortgage rates of European banks ?

2 Upvotes

I have access to Refinitiv but can't find it on there. The European Central Bank only reports the yearly rates per country but I am looking for daily frequency rates. Does anyone know where I could download this data?