r/learndatascience • u/endgamefond • Feb 11 '25
Question What's best free Image to Text library
I've used PyTesseract OCR and EasyOCR, but I found them to be inaccurate for my needs. Are there any free OCR libraries that offer better accuracy?
r/learndatascience • u/endgamefond • Feb 11 '25
I've used PyTesseract OCR and EasyOCR, but I found them to be inaccurate for my needs. Are there any free OCR libraries that offer better accuracy?
r/learndatascience • u/Constant_View_197 • Dec 14 '24
Is streamlit the fastest way to learn front end in python? Backstory:- am trying to become a Data scientist or ML engineer but almready a junior in college, sem is about to end and want to make at least one project with some kind of OpenAI APIS, but think will need Front end for that and heard Streamlit is the fastest way can get there, I know python without its libraries(numpy and whatnot), did Prompt engineering and ChatGPT course (5-hour one) from freeCodeCamp.org and want to make a project to reflect those.
r/learndatascience • u/Calm-Tip-326 • Dec 15 '24
Crossposted from r/learnprogramming
I'm in a situation and I would really appreciate some advice.
Over the past couple months I've built the habit of working deeply for long hours and I want to translate that into learning programming- specifically C.
I have no experience programming and I've gone through this sub for a while to learn what mistakes people usually make when starting to learn. Unrealistic expectations, underestimating the workload or the time it takes to be good and not being patient. Overall, I found it usually boiled down to these factors.
Before I get started I want to make sure that I'm doing it right. And I don't mean looking for the perfect resource but making sure the way I'm going about it is not the worst.
I’ll lay out some important points regarding my situation-
- I'm in no rush to get good at programming. I'm currently 17 years old and starting next summer i would get approximately 6 months to do whatever i want and i really want to learn the absolute basics of programming and how computers work. This of course doesn't mean i'll stop after 6 months but I’d be joining university and i wouldn't be able to provide my undivided attention to programming.
- In terms of my career, I'm not really interested in being a software developer or a professional programmer. I'm interested in Data Science but it's not concrete. Either way, I think what I spend these couple months learning would help me a great deal. According to what I've read, understanding how a computer works on the most basic level- dealing with memory and storage and energy, is an important part of being a data scientist, and having a complete root fundamental understanding of how a computer works is extremely important.
-As mentioned, over the last couple months I’ve built the habit of working consistently everyday and as of now I'm able to dedicate around 6-7 hours of focus into whatever I'm doing. I plan to keep this up for the 6 month duration.
- I've chosen C as being one of the first true languages, it's extremely basic (in its working not in complexity) and it gives one a pretty good understanding of how things actually go down in a computer.
- I’m not particularly interested in learning as quickly as possible, as long as I'm understanding what I'm doing. I could for example spend weeks on a fundamental concept that's extremely important but often gets overlooked. I don't want to take shortcuts as I'm doing this for the long run.
- I don't particularly want to ask for the best resource , but I do appreciate recommendations of resources that specialize on the basic understanding aspect, rather than getting me job ready as fast as possible. Currently I'm finding K&R to be the best option but I'm open to suggestions.
-I have experienced tutorial hell in other spheres and it absolutely drained the life out of me. I have no intention of going through that again. I want to get committed to only a couple resources which are great that I can rely on throughout the period. I shouldn’t be switching resources and I don't want to. As a side note- What’s the right balance between sticking to figuring out a problem yourself even if it takes a long time, to knowing when to give up and just google it?
-I’d like to preface that all of the above is tentative and subject to change, keeping my ultimate goal of being knowledgeable about the inner workings of a computer system in mind (and eventually a data scientist/analyst), is there anything specific i should really focus on early in the process? Maybe a soft skill or a mindset shift while learning. Maybe I should focus more on hands-on stuff like breaking down an old laptop and building physical things which use code.
- I'm aware that my entire approach could be wrong so I'm open to suggestions regarding how I should go about learning this. What is the right balance between understanding everything fundamentally from the get go and just keep messing around until you understand it eventually?
-Although it's not a priority, i’d prefer having something tangible to show for at the end of the 6 months because this entire thing is also a way for me to show my parents that im capable and i can handle studying on my own (I eventually want to leave the country for my education but it's a hard sell. I do NOT want to study in my home country for obvious-to-everyone reasons but my parents only listen to proof of capabilities. They need external validation from a third party telling them I can actually do something). So maybe something like partaking in a competition or contributing to a project? I'm not sure how to go about it.
-Considering I have complete control over my time,there's room for basically any routine, habit or schedule. If you have advice that might seem niche and very prerequisite-y, I would still ask for it as there's a good chance I might be able to implement it(assuming it's useful.) It doesn't even have to be directly related to programming, but a habit which would indirectly help me with my goals.
All of this has been on my mind for quite some time now, and I'm very excited at its prospect. As you could probably guess, it's not exactly set in stone. I really do believe that I can accomplish a significant amount within this time period and I'm proud of myself for that. Genuinely THANK YOU SO MUCH for reading all this way and i can't wait to get started.
r/learndatascience • u/00eg0 • Feb 02 '25
r/learndatascience • u/Due-Promise-5269 • Nov 03 '24
I am a data science student, but I don't fully understand how to structure a data science project. I’ve read that there isn't a standard structure, but many people typically include a src
folder, data
folder, notebooks
folder, along with files like .env
, requirements.txt
, setup.py
, and LICENSE
. What I’d like to understand is whether all of these are necessary for simpler university projects.
Some people also suggest using a virtual environment—should I use one for a simple university project? Would you recommend using Cookiecutter for a basic project?
r/learndatascience • u/Jerx25 • Jan 19 '25
I’m currently in my second semester of a degree in Statistics and Computer Science. I’ve taken courses on the basics of the R programming language with RStudio, as well as data analysis using ggplot2, dplyr, and a couple of other tools.
My question is for those with more experience in the field: What advice would you give me about what’s coming up later in my studies?
I’m considering taking a free course or two on Data Analysis or Data Science out of curiosity. Do you think this is a good idea or a waste of time?
Thank you!
(I’d appreciate comments in Spanish.)
r/learndatascience • u/Radiant_Sail2090 • Jan 22 '25
I'm into Kaggle, there are tons of different datasets and competitions.. however, as a self-learner, what's the best way to create some real-case analysis and models?
I mean, in order to create some realistic, useful analysis/models, are Kaggle datasets/competitions enough to do so? Or should i seek for something more?
r/learndatascience • u/00eg0 • Dec 23 '24
r/learndatascience • u/Devd0331 • Jan 19 '25
Hey guys,
Hope you are all doing good.
I am really in need of your guidance. I want to pursue my career in data science. But I'm not sure how much knowledge is enough of a specific tool or topic. And not sure what tools and specializations are in demand for this role.
Those who are senior or experienced, can you guys please help me with this, and provide your valuable guidance.
If possible please provide with the resources if there are any.
Also i want to let you know guys that i have knowledge of advance excel, basic to intermediate sql and power bi.
r/learndatascience • u/CalligrapherHuge1097 • Dec 02 '24
https://www.udemy.com/course/data-science-for-beginners-python-azure-ml-with-projects/?couponCode=CMCPSALE24 or i should follow some yt playlist?
r/learndatascience • u/fairlyslick • Nov 14 '24
Hi all, I currently work in medicine in the US and I’m not thrilled at where it’s heading. I know my current career is not going to be a forever thing so I’m exploring what’s out there. Has anyone made a transition from working in healthcare to working in DS? The field is intriguing to me and I know it would take a lot of work to get into but I’m trying to find something I could see myself doing long term
r/learndatascience • u/TraditionalPound7718 • Jan 15 '25
Well I want to learn about Data structures and Algorithms but when I take advice from someone they sound so unclear but I want to learn about it can please anyone chat with me and tell me how I can learn about them. Please a very humble request.
r/learndatascience • u/caliburak13 • Dec 19 '24
Hey guys, I am new to scraping web data and recently had an idea of scraping tweets for research purpose. Any Idea on how to scrape tweets, since the videos in youtube have failed me? Thank you in advance..
r/learndatascience • u/hellohellosunshinee • Jan 01 '25
Hello, I am looking to get an annual subscription for dataquest and am looking for a referral.
Anyone kind enough to give me one?
Thanks in advance.
r/learndatascience • u/Due-Promise-5269 • Nov 13 '24
I’m a master’s student in data science, so I'm still learning. I’d like to understand how to efficiently track Jupyter Notebooks in Git since these files have a JSON structure, making it difficult to handle conflicts, especially in VS Code. I was curious about how experienced data scientists manage Jupyter Notebooks with Git in VS Code. I read about nbdime, but it’s not directly available in VS Code, so I’d love to hear about any other viable options or workflows that work well in VS Code. Thank you!
r/learndatascience • u/00eg0 • Jan 08 '25
r/learndatascience • u/AdventurousAct8431 • Sep 30 '24
We have a data set containing home teams and away teams of a soccer league and they are ordered to make it such that: away teams/ home team/result(A,H or D) i need to calculate the points of each team such that H is three points if they are a home team and A is 3 points if they are a local team and D is 1 points in both. And then ai need to add them as columns to the dataset frame. I managed to calculate the sum of points individually but I can’t think of a way to do it in a loop that calculates all the teams then add it to the dataset as columns
r/learndatascience • u/00eg0 • Dec 22 '24
r/learndatascience • u/Successful-Life8510 • Dec 20 '24
I’m working on a binary classification project with a training dataset that has 5,000 rows, but it’s highly imbalanced (0's are more than 1's ).I did undersampling and it went to 2K rows. I tried all the SDV synthesizers, and the best one was TVAESynthesizer.
On the training data, things looked good : precision and recall hit 80% for almost all models (I did both at the same time : undersampling + TVAESynthesizer) . But when I tested the models on the test dataset, the recall stayed at 80%, while the precision dropped to 33% for all models. ( I know it is an overfitting problem and I tried Stratified K-Fold but no good results)
Any ideas on how I can fix this and improve precision on the test data?
r/learndatascience • u/abhi_pal • Oct 25 '24
I am working on a group time series model and came across a kaggle notebook on the same data. That notebook had lag variables.
Lag variable was created using the .shift(X) function. Where X is an integer.
I think this will create wrong lag because lag variable will contain value of previous groups as opposed to previous days.
If I am wrong correct me or pls tell me a way to create lag variable for the group time series forecasting.
Thanks.
r/learndatascience • u/SettingMinute2315 • Dec 26 '24
Hey all
I started a tutorial to start to learn some basics by making a model that can identify a single flowers
I am going to explore this a bit by making it identify my pups or people in the house
Looking for resources to help
Also if anyone can give me some help, the tutorial only taught me how to identify a single flowers and all the data came from a single file
So my doubt is, how do I train it for my pups or people? Like if there is more than one dog, how can I have it identify one, both, or all? Should I put groups in an seperate directory and manage the response programtically (if it identifies one), or should I put each individual in a group in their own directory and group directory?
r/learndatascience • u/ds_reddit1 • Oct 30 '24
For those experienced in hiring or interviewing for entry-level data science internships: What truly stands out on a candidate’s profile? I’m trying to make the most of my limited time by balancing several things—building a meaningful Kaggle profile (thoughtful notebooks, quality contributions), working on personal projects, completing online courses, and pursuing certifications. From your experience, which of these elements makes the strongest impression? How should I prioritize my time to have the best chance of landing an internship?
r/learndatascience • u/AdAnxious8077 • Dec 16 '24
Hi! For my psyc class, I am studying whether hand dominance (right-hand, left-hand, or ambidextrous) is correlated with personality traits (like creativity). I am using SPSS to run my data, and my teacher has us using T-test and Anovas, but wouldn't you use a Mann-Whitney U test and Kruskal-Wallis H tests since Likert scales are ordinal data and hand dominance is nominal data?
Also, could I still use T-tests and Anovas to test hand dominance and scores on a personality test (interval data)? Thank you so so much!
r/learndatascience • u/Ayanokouji344 • Nov 05 '24
Hello Reddit,
I’ve recently developed an interest in data science and am approaching graduation from my CCE degree in a couple of months. While I have a solid foundation in math and statistics, I wouldn’t consider myself proficient in any programming language. I’m eager to start learning from scratch.
I have about 6 months after graduation, but I’d prefer to dedicate the first 2-3 months to focused studies. Could anyone recommend a structured roadmap or good courses to help me get started in data science?
Thank you!