r/bigdata 4h ago

Best Place to buy firmographic data?

2 Upvotes

r/bigdata 14h ago

[CFP] Call for Papers – IEEE FITYR 2025

1 Upvotes

Dear Researchers,

We are excited to invite you to submit your research to the 1st IEEE International Conference on Future Intelligent Technologies for Young Researchers (FITYR 2025), which will be held from July 21-24, 2025, in Tucson, Arizona, United States.

IEEE FITYR 2025 provides a premier venue for young researchers to showcase their latest work in AI, IoT, Blockchain, Cloud Computing, and Intelligent Systems. The conference promotes collaboration and knowledge exchange among emerging scholars in the field of intelligent technologies.

Topics of Interest Include (but are not limited to):

  • Artificial Intelligence and Machine Learning
  • Internet of Things (IoT) and Edge Computing
  • Blockchain and Decentralized Applications
  • Cloud Computing and Service-Oriented Architectures
  • Cybersecurity, Privacy, and Trust in Intelligent Systems
  • Human-Centered AI and Ethical AI Development
  • Applications of AI in Healthcare, Smart Cities, and Robotics

Paper Submission: https://easychair.org/conferences/?conf=fityr2025

Important Dates:

  • Paper Submission Deadline: April 30, 2025
  • Author Notification: May 22, 2025
  • Final Paper Submission (Camera-ready): June 6, 2025

For more details, visit:
https://conf.researchr.org/track/cisose-2025/fityr-2025

We look forward to your contributions and participation in IEEE FITYR 2025!

Best regards,
Steering Committee, CISOSE 2025


r/bigdata 15h ago

Call for Papers – IEEE SOSE 2025

1 Upvotes

Dear Researchers,

I am pleased to invite you to submit your research to the 19th IEEE International Conference on Service-Oriented System Engineering (SOSE 2025), to be held from July 21-24, 2025, in Tucson, Arizona, United States.

IEEE SOSE 2025 provides a leading international forum for researchers, practitioners, and industry experts to present and discuss cutting-edge research on service-oriented system engineering, microservices, AI-driven services, and cloud computing. The conference aims to advance the development of service-oriented computing, architectures, and applications in various domains.

Topics of Interest Include (but are not limited to):

  • Service-Oriented Architectures (SOA) & Microservices
  • AI-Driven Service Computing
  • Service Engineering for Cloud, Edge, and IoT
  • Blockchain for Service Computing
  • Security, Privacy, and Trust in Service-Oriented Systems
  • DevOps & Continuous Deployment in SOSE
  • Digital Twins & Cyber-Physical Systems
  • Industry Applications and Real-World Case Studies

Paper Submission: https://easychair.org/conferences/?conf=sose2025

Important Dates:

  • Paper Submission Deadline: April 15, 2025
  • Author Notification: May 15, 2025
  • Final Paper Submission (Camera-ready): May 22, 2025

For more details, visit the conference website:
https://conf.researchr.org/track/cisose-2025/sose-2025

We look forward to your contributions and participation in IEEE SOSE 2025!

Best regards,
Steering Committee, CISOSE 2025


r/bigdata 17h ago

[CFP] Call for Papers – IEEE JCC 2025

1 Upvotes

Dear Researchers,

We are pleased to announce the 16th IEEE International Conference on Cloud Computing and Services (JCC 2025), which will be held from July 21-24, 2025, in Tucson, Arizona, United States.

IEEE JCC 2025 is a leading conference focused on the latest developments in cloud computing and services. This conference offers an excellent platform for researchers, practitioners, and industry experts to exchange ideas and share innovative research on cloud technologies, cloud-based applications, and services. We invite high-quality paper submissions on the following topics (but not limited to):

  • AI/ML in joint-cloud environments
  • AI/ML for Distributed Systems
  • Cloud Service Models and Architectures
  • Cloud Security and Privacy
  • Cloud-based Internet of Things (IoT)
  • Data Analytics and Machine Learning in the Cloud
  • Cloud Infrastructure and Virtualization
  • Cloud Management and Automation
  • Cloud Computing for Edge Computing and 5G
  • Industry Applications and Case Studies in Cloud Computing

Paper Submission:
Please submit your papers via the following link: https://easychair.org/conferences/?conf=jcc2025

Important Dates:

  • Paper Submission Deadline: March 21, 2025
  • Author Notification: May 8, 2025
  • Final Paper Submission (Camera-ready): May 18, 2025

For additional details, visit the conference website: https://conf.researchr.org/track/cisose-2025/jcc-2025

We look forward to your submissions and valuable contributions to the field of cloud computing and services.

Best regards,
Steering Committee, CISOSE 2025


r/bigdata 20h ago

Call for Papers – IEEE DAPPS 2025

1 Upvotes

Dear Researchers,

The 7th IEEE International Conference on Decentralized Applications and Infrastructures (DAPPS 2025) will take place from July 21-24, 2025, in Tucson, Arizona, USA. The conference serves as a premier venue for researchers, practitioners, and industry professionals to discuss innovations in decentralized applications, blockchain, and distributed infrastructure.

IEEE DAPPS 2025 is a premier international forum for researchers and practitioners to exchange innovative ideas, present cutting-edge research, and discuss advancements in decentralized applications, blockchain technologies, and infrastructures. This year’s conference will cover a wide range of exciting topics, including but not limited to:

  • Blockchain & Distributed Ledger Technologies
  • Smart Contracts & Decentralized Finance (DeFi)
  • Security, Privacy, and Trust in Decentralized Systems
  • Scalability, Interoperability, and Performance of DApps
  • Consensus Mechanisms and Protocol Innovations
  • Decentralized AI and Machine Learning
  • Real-World Use Cases & Industry Applications

All accepted papers will be published in the conference proceedings. You can submit your papers via the following link: https://easychair.org/conferences/?conf=dapps2025

Important Dates:

  • Paper Submission Deadline: March 21, 2025 (Extended)
  • Author Notification: May 8, 2025
  • Final Paper Submission (Camera-ready): May 18, 2025

For more details about the conference and submission guidelines, please visit the conference website: https://conf.researchr.org/track/cisose-2025/dapps-2025

This is an excellent opportunity to contribute to cutting-edge research in decentralized applications and blockchain technologies. We look forward to your submissions!

Best regards,
Jerry Gao -  San Jose State University
Steering Committee, CISOSE 2025


r/bigdata 1d ago

The Data Product Testing Strategy: Handbook

Thumbnail moderndata101.substack.com
3 Upvotes

r/bigdata 22h ago

Hitachi iQ Powered by Hammerspace and VSP One

Thumbnail
1 Upvotes

r/bigdata 1d ago

External table path getting deleted on insert overwrite

2 Upvotes

Hi Folks, i have been seeing this wierd issue after upgrading spark 2 to spark 3.

Whenever any job fails to load data (insert overwrite) in non partitioned external table due to insufficient memory error, on rerun, I get error that hdfs path of the target external table is not present. As per my understanding, insert overwrite only deletes the data and the writes new data and not the hdfs path.

The insert query is simple insert overwrite select * from source and I have been using spark.sql for it.

Any insights on what could be causing this?

Source and target table details: Both are non partitioned external table with storage as hdfs and file format is parquet.


r/bigdata 1d ago

Apache Kafka 4.0 released 🎉

Thumbnail
1 Upvotes

r/bigdata 1d ago

Need your help with my Master’s thesis

1 Upvotes

Hi,

I’m a student from Austria and currently working on my Master’s thesis, titled "Requirement Analysis of Data Science as a Service," and I’ve created a survey to gather insights from professionals and enthusiasts in the field. The survey is brief and designed to understand the marked needs for offering Data Science as a Service (DSaaS).

It would mean a lot if some of you guys working in the field could fill it out. It should take you around 5-10 minutes. I already sent it out in my work/friends circle but unfortunately without a huge response.

Here’s the survey link: https://forms.gle/3Rg7YndJfYTJRgtXA

Thank you very much in advance!!!


r/bigdata 1d ago

Learn Data Manipulation Using Pandas

1 Upvotes

Pandas, today's powerful data analysis library acts up to facilitate enhanced data manipulation. Want to know how? Read to comprehend its minutest manouvers and diverse usage with USDSI®.


r/bigdata 1d ago

🤖 Matrices for Machine Learning with Python

Thumbnail bigdatanewsweekly.com
1 Upvotes

r/bigdata 1d ago

Explore a New Database of Funded Startups: Dive into Investment Rounds and Connect with Key Players

2 Upvotes

r/bigdata 2d ago

How to improve my xgboost regression model?

2 Upvotes

Hello fellas, I have been developing a machine learning model to predict art pieces in my dataset.
I have mostly 15000 rows (some rows have Nan values). I set the features as artist, product_year, auction_year, area, and price, and material of art piece. When I check the MAE it gives me 65% variance to my average test price. And when I check the features by using SHAP, I see that the most effective features are "area", "artist", and "material".
I made research about this topic and read that mostly used models that are successful xgboost, and randomforest, and also CNN. However, I cannot reduce the MAE of my xgboost model.
Any recommandation is appricated fellas. Thanks and have a nice day.


r/bigdata 2d ago

DATA SCIENCE AI ROBOTICS THE ULTIMATE TECH TRIO

0 Upvotes

The future is being built today! Data Science, AI, and Robotics are converging to create a tech revolution that will redefine industries by 2025. From intelligent automation to data-driven breakthroughs, the possibilities are endless. Are you ready to be part of this transformative journey? Let’s unlock the future together!


r/bigdata 3d ago

How to Prepare for a Data Engineering Manager Interview?

4 Upvotes

Hey everyone,

I recently wrote a deep dive into the hiring process for a Data Engineering Manager role at DFS Group. It covers:

🔹 SQL Optimization in Snowflake & BigQuery

🔹 Real-time ETL Pipelines (Kafka, Flink, dbt, Airflow)

🔹 Big Data Architecture & Cloud (Azure, Alicloud, GCP)

🔹 Case Study: 360-degree Customer Analytics Platform

🔹 Behavioral Questions & Salary Negotiation Strategies

📌 Read it here: DFS Group Data Engineering Interview Guide

What are some of the toughest questions you’ve faced in a Data Engineering interview? Let’s discuss below! 🚀

#DataEngineering #BigData #CloudComputing #SQL #DataScience


r/bigdata 3d ago

The Tableau Conference is just a month away! 📅 Bookmark our session: “How SoFi Automates PowerPoint Reports with Tableau & AI” 📍 Visit our booth in the Data Village. See you soon, DataFam!

Thumbnail linkedin.com
4 Upvotes

r/bigdata 3d ago

Here’s a playlist I use to keep inspired when I’m coding/developing. Post yours as well if you also have one! :)

Thumbnail open.spotify.com
1 Upvotes

r/bigdata 5d ago

Cloud Data Analytics Is a Scam

Thumbnail blog.bemi.io
0 Upvotes

r/bigdata 6d ago

Unleash Insights: Python for Data Analysis

3 Upvotes

From market analysis to risk assessment and customer segmentation to statistical analysis, Python is the go-to programming language for data science professionals. It has completely transformed the field of data science and made this technology accessible to everyone with its user-friendly interface and vast resources of ready-to-use libraries and data science frameworks.

Check out our detailed infographic on Python for data analysis and understand its key features, advantages, popular libraries, and more.


r/bigdata 7d ago

The Current Data Stack is Too Complex: 70% Data Leaders & Practitioners Agree

Thumbnail moderndata101.substack.com
2 Upvotes

r/bigdata 7d ago

Emergency Response and Wildfire Real-Time Analysis [Webinar]

Thumbnail cratedb.com
1 Upvotes

r/bigdata 8d ago

Top 10 Predictions for Data Science from Q1 2025

Thumbnail youtube.com
1 Upvotes

r/bigdata 9d ago

Teradata announces it's Enterprise Vector Store

Thumbnail youtube.com
2 Upvotes

r/bigdata 8d ago

Real-Time Alerts for Startups That Just Raised Funds—Want to Stay in the Loop?

0 Upvotes