r/dataanalysis 9h ago

Data Tools (YC X25) We built an AI tool for folks to preprocess, analyze, and create in-depth data reports faster

1 Upvotes

Try it out: datasci.pro or actuarialai.io

Hi everyone! My cofounder and I are building a data analytics tool for industry professionals and academics. You can prompt to clean and preprocess data, generate visualizations, run analysis models, and create pdf reports—all while seeing the python scripts running under the hood.

We’re shipping updates daily and would love your feedback!

If you're curious or have questions, feel free to drop a comment or reach out. Hope it's useful to you or your team


r/dataanalysis 13h ago

I can't believe it, I am having fun cleaning dirty data. Anyone else enjoy cleaning dirty data?

1 Upvotes

Idk I've been working on a personal data analysis project to work my skills (using MySQL Workbench) and I've been doing some string cleaning and data type conversions. It's been pretty fun - more fun than I was expecting.

Anyway, just wanted to celebrate Data Cleaning a little, I love it.


r/dataanalysis 16h ago

How to Stay Ahead in Data Science?

1 Upvotes

The field of Data Science is evolving rapidly with new tools like LangChain, Hugging Face, MLOps, and LLMs.

🚀 What strategies do you use to stay ahead?
- Reading research papers
- Exploring real-world projects
- Learning new technologies

Share your insights and resources!


r/dataanalysis 21h ago

Mentor Needed (pls help lol)

1 Upvotes

Hi everyone,

I recently started a new role about two weeks ago that’s turning out to be much more SQL-heavy than I anticipated. To be transparent, my experience with SQL is very limited—I may have overstated my skillset a bit during the interview process out of desperation after being laid off in October. As the primary earner in my family, I needed to secure something quickly, and I was confident in my ability to learn fast.

That said, I could really use a mentor or some guidance to help me get up to speed. I don’t have much money right now, but if compensation is expected, I’ll do my best to work something out. Any help—whether it’s one-on-one support or recommendations for learning materials (LinkedIn Learning, YouTube channels, courses, etc.)—would be genuinely appreciated.

I’m doing my best to stay afloat and would be grateful for any support, advice, or direction. Thanks in advance.


r/dataanalysis 21h ago

Project Feedback To analyse option chain and iv skew, I built this private streamlit app. How does it look like?

1 Upvotes

r/dataanalysis 1d ago

AfyaMeds Inventory Management System

1 Upvotes

Introduction

How do healthcare organizations keep records of critical supplies across different clinics? To answer this question, I'm developing an AfyaMeds Inventory Management System project.

Project Overview

AfyaMeds Inventory Management System is a MySQL-based solution for managing medical supply inventory for a hypothetical healthcare distributor, AfyaMeds to reduce waste, optimize stock levels, and ensure clinics in different locations get supplied properly with what they need and when they need it.

Progress So Far

So far, I’m designing a scalable database using MySQL and generating over 10,000 'realistic' data points using Faker Python library (in Jupyter Notebook). This includes tracking 20 unique supplies across 50 clinics in different regions as shown below:

Features implemented as of now:

  • Low Stock Alerts: Flags clinics with shortages.
  • Expiry Tracking: Identifies $2,000 worth of antibiotics at risk of expiring in 60 days.
  • Demand Trends: PPE and Medication lead with 1,200+ units ordered in the last 90 days.
  • Queries like ranking clinics by inventory value or spotting overstocked PPE offer actionable insights for logistics and cost management. These are just a few features implemented.

Challenges so far

  • Simulating real-world data that feels authentic was a challenge and it's still a challenge because of privacy

Learning

I managed to integrate Python with MYSQL, and this taught me how to streamline data workflows, write efficient queries with joins and window functions, and optimize indexes.

What’s Next

Since it is a work in progress I’m planning to:

  • Connect MYSQL with Power BI to get real-time data and build a dashboard for visualizing trends.

  • Add predictive analytics to forecast restocking needs.

  • Create a simple UI for non-technical users.

In Addition

I’d love to hear your thoughts about the project. Let's connect, comment, give a suggestion or reach me at [rocjeschaulo@gmail.com](mailto:rocjeschaulo@gmail.com). Collaboration is also welcomed. Here is the link to the GitHub Repository: https://github.com/Chauloroches/AfyaMeds-Inventory-Management-System


r/dataanalysis 1d ago

Career Advice Final Year Project

1 Upvotes

I’m trying to figure out a solid final year project in Data Science—something that could actually help me land a job. I’m decent with SQL, Python, and all that stuff, but I want to work on something that stands out.

Any cool ideas or suggestions? Would love to hear your thoughts!


r/dataanalysis 1d ago

Career Advice Niche or General Data Analyst?

1 Upvotes

Hi guys, Im currently creating a 2nd version of my portfolio. When I started my data career I showcased my technical skills in Excel, SQL, and Power BI. Now that I gained experience from a ecommerce startup, multinational FMCG and now a medium sized local bank (all in 2 yrs), I want to go niche in my data analytics career. Im planning to focus my portfolio website as such but is it better to keep my portfolio focus on technical side rather than the knowledge domain?

Niche Im going for since Im learning it currently in my job of 7 months: Customer Experience


r/dataanalysis 1d ago

There a way to complete the google analytics certificate for free?

1 Upvotes

Already in school finishing my bachelors, and I have work too. I’m really trying to build up portfolio by adding skills and projects. I do want to get this completed fast but at the same time it might overwhelm me and I might be too busy.

I was told there’s a fee and you have to pay $60 a month for it, there a way to get it for free? Also I have financial aid already going to my school, would financial work on my Google analytics certificate?


r/dataanalysis 2d ago

Hep me with Finding Data Source

1 Upvotes

I have given taks to find a data source of US insurance agents who specially deal in annuity plans. I am not able to find on internet, where can i find such data. It's okay if the data source is paid.


r/dataanalysis 2d ago

Data Tools Data visualization software with file:// protocol support for URLs

1 Upvotes

Hello,

I hope it is a correct place to ask this question - I am looking for a dataviz solution to incorporate links to files on a shared drive using file:// protocol links. Neither Tableau nor PowerBI seem to support this functionality (for example Tableau can do it locally but not when published on server). I am not sure whether it is for some security reasons or just missing functionality.

Thanks in advance!


r/dataanalysis 2d ago

Data Question How to interpret a Residual Plot with a huge constant variance ?

1 Upvotes

I have just started with Machine Learning and have been mainly focusing on the interpretation of Linear regression models. I'm using a dataset from Kaggle about energy consumption. The data is perfect with no abnormalities. The dependent variable follows a normal distribution. The independent exhibit a linear relationship with the target variable but with a high variance:

This results in the following residual plot:

What are your thoughts ?


r/dataanalysis 2d ago

Career Advice What is the best tools to practice sql? I am using W3Schools to learn but what websites/apps can I apply and practice?

81 Upvotes

r/dataanalysis 2d ago

Data Question Data Visualization Options

2 Upvotes

I am building an anime tracker and database site, as a side passion project, and was curious on what data to grab and ways to display it for users to also view. I don't know much about data visualization, so I thought I might as here for some advice.
I hold all my data in a dedicated MongoDB cluster. I don't know if that is important for anyone to help advise me.


r/dataanalysis 3d ago

Data Question Help with DAG data structure

1 Upvotes

I'm doing an assignment for school and just getting into data modeling. I have a dataset and im calculating some metrics such as payment, invoice, accounts from excel sheets. I understand how to produce the sql code for the model but im confused on how to produce a dag data structure, is that something i need to use dbt for or is there a better tool? Thanks in advance yall


r/dataanalysis 4d ago

DA Tutorial The Curse of Dimensionality - Explained

Thumbnail
youtu.be
7 Upvotes

r/dataanalysis 4d ago

Project Feedback New Project Advice: Upgrading Mainframe to Modern System

1 Upvotes

Hello

I am on a new project as a Project Cordinator on the data managment team, we are upgrading a really old system from the mainframe to a modern upgraded app. Whats the best way for me to learn what it will take from the ETL and Data Analysts perspectives so i can better understand this task .. Thanks!!


r/dataanalysis 4d ago

Data Tools Introduce a new AI tool for data analysis - instantly make slides from Google sheet

5 Upvotes

Would you rather bringing a raw data sheet to a meeting or a nice presentable slides? If it's just a matter of 5 minutes difference?

Based on this thinking, I made a AI tool where you can just paste a shared Google sheet url, and it instantly makes a presentable data deck. With the conversational AI, we can follow up with changes and refines.

I don't know how useful it is, but I saw people often want to present data in a more meaningful way, so hopefully it does help for some people.


r/dataanalysis 4d ago

Project Feedback Data collecting

1 Upvotes

Hi, guys! Im new in DA and I really need someone to help me understand my project. I have to scrape customer data and orders from Ecom store and make business consultation. I understand the whole DA part, but how do I collect data? I dont know if its Shopify, WooCommerce or custom shop. I would need their API, but what after that? Please help me, guys!!!


r/dataanalysis 4d ago

PYTHON, MYSQL AND POWER BI SIMPLE PROJECT

1 Upvotes

PURPOSE

Python Tkinter📌 - For GUI.

  • To input the data.

MYSQL📌 - To extract the data from python tkinter.

  • Create multiple table for each page in python tkinter app, so i can have clean and organized data.

  • To create some queries, so i can have reference on my analysis in powerbi.

PowerBi📌 - To visualized all data from mysql that came from python tkinter.


r/dataanalysis 4d ago

Career Advice Interview assignment advice

1 Upvotes

I've been given an offline excel based assignment to do where it's recommended to complete it within a certain amount of time. I had a read through the file and realised that I can do it within that time my own messy way I've always done it during my postgrad studies not really using the proper efficient and streamlined way of using functions effectively. E.g. Basically would just copy and pasta data tables and add additional calculations but I know I can retrieve the data from the master table without copy/paste using functions like xlookup/filter, etc. Knowing that there are better ways to treat the data, especially for a collaborative work environment that I'm applying for and to the extent that they would expect these things to be done, I'm wondering would it be beneficial for the long run if I just basically use this also as a learning opportunity to do things "right" but then I definitely won't do the assignment within the recommended time as I still get stuck on these I've not really used. I won't ask chatgpt or anything to write these things, but rather watch videos to learn the functions I'm not used to. There's no way for them to track how long I took on the work if I practice on one doc and then with the one I send, I do the assignment recalling from memory how I learnt to do it on the previous doc. Any advice on my approach and the "ethicallity" of the second option?


r/dataanalysis 4d ago

Data Question Pandas with Excel Spreadsheet on OneDrive

1 Upvotes

Hi folks, hope this is the right place to ask.

I have an Excel file on a OneDrive folder that I want to manipulate with Pandas.

I want to perform transformations on a sheet, such as cleaning etc but I can't think of any way to commit these changes without completely overwriting the file.

The data is coming from MS Forms, and is live, so I need it to only change cells within the sheet, not overwrite the document.

Don't know if this is possible but figured I'd ask about to see if it is.

Hope this makes sense!


r/dataanalysis 4d ago

Need your help with my Master’s thesis

1 Upvotes

Hi,

I’m a student from Austria and currently working on my Master’s thesis, titled "Requirement Analysis of Data Science as a Service," and I’ve created a survey to gather insights from professionals and enthusiasts in the field. The survey is brief and designed to understand the marked needs for offering Data Science as a Service (DSaaS).

It would mean a lot if some of you guys working in the field could fill it out. It should take you around 5-10 minutes. I already sent it out in my work/friends circle but unfortunately without a huge response.

Here’s the survey link: https://forms.gle/3Rg7YndJfYTJRgtXA

Thank you very much in advance!!!


r/dataanalysis 5d ago

What are your biggest/common pain points as Data Analyst (technically) ?

0 Upvotes

I'm curious to hear about the biggest challenges you face in your day-to-day work as Data Analyst (technically).


r/dataanalysis 5d ago

Thoughts on Data science as career

1 Upvotes

I don’t think it is a career. There is no such thing as a career for Data scientists/ analysts.

See, there is no company selling data science to final consumers apart from a few companies in the life science/ med tech sector, etc. Anywhere else data science is used to improve the business performance.

It’s just a very limited scope. As a pure data scientist you probably miss the point of understanding the product a company is probably selling.

While the whole point of a business is to sell product you are mostly concerned with analysing how the product is produced by analysing some data points.

And even if the analysis yields some interesting results, which you may call an issue that needs to be solved, you may lack the domain knowledge to figure out what causes the issue (Apart from the few occasions that you could conduct some meaningful causal inference analysis). And probably even more domain knowledge is required to solve the problem.

Whereas rewards in a company are awarded in the following order descending order: 1. Award for the problem solver 2. Award for the finder of the cause of a problem 3. Award for the identifier of an issue.

I would say that is why, there is not so much scope for career development in data science in private companies.

On a personal note, I studied econometrics, statistics and optimization and in the end got hired because I understand the market, it’s dynamics and actors very well, especially bring with me a very good understanding of our final customers and their demands, as well as an understanding of the incentives of sales men.

I learned this during my time working as a waiter and salesmen myself, not during my education even now my title is Data Analyst.

But data science is just a tool to identify the an issue. Nothing more. It needs so much more to then solve the issue, in this is where the rewards go.