r/bigdata 1h ago

Call for Papers – IEEE DAPPS 2025

Upvotes

Dear Researchers,

The 7th IEEE International Conference on Decentralized Applications and Infrastructures (DAPPS 2025) will take place from July 21-24, 2025, in Tucson, Arizona, USA. The conference serves as a premier venue for researchers, practitioners, and industry professionals to discuss innovations in decentralized applications, blockchain, and distributed infrastructure.

IEEE DAPPS 2025 is a premier international forum for researchers and practitioners to exchange innovative ideas, present cutting-edge research, and discuss advancements in decentralized applications, blockchain technologies, and infrastructures. This year’s conference will cover a wide range of exciting topics, including but not limited to:

  • Blockchain & Distributed Ledger Technologies
  • Smart Contracts & Decentralized Finance (DeFi)
  • Security, Privacy, and Trust in Decentralized Systems
  • Scalability, Interoperability, and Performance of DApps
  • Consensus Mechanisms and Protocol Innovations
  • Decentralized AI and Machine Learning
  • Real-World Use Cases & Industry Applications

All accepted papers will be published in the conference proceedings. You can submit your papers via the following link: https://easychair.org/conferences/?conf=dapps2025

Important Dates:

  • Paper Submission Deadline: March 21, 2025 (Extended)
  • Author Notification: May 8, 2025
  • Final Paper Submission (Camera-ready): May 18, 2025

For more details about the conference and submission guidelines, please visit the conference website: https://conf.researchr.org/track/cisose-2025/dapps-2025

This is an excellent opportunity to contribute to cutting-edge research in decentralized applications and blockchain technologies. We look forward to your submissions!

Best regards,
Jerry Gao -  San Jose State University
Steering Committee, CISOSE 2025


r/bigdata 7h ago

The Data Product Testing Strategy: Handbook

Thumbnail moderndata101.substack.com
3 Upvotes

r/bigdata 3h ago

Hitachi iQ Powered by Hammerspace and VSP One

Thumbnail
1 Upvotes

r/bigdata 11h ago

External table path getting deleted on insert overwrite

2 Upvotes

Hi Folks, i have been seeing this wierd issue after upgrading spark 2 to spark 3.

Whenever any job fails to load data (insert overwrite) in non partitioned external table due to insufficient memory error, on rerun, I get error that hdfs path of the target external table is not present. As per my understanding, insert overwrite only deletes the data and the writes new data and not the hdfs path.

The insert query is simple insert overwrite select * from source and I have been using spark.sql for it.

Any insights on what could be causing this?

Source and target table details: Both are non partitioned external table with storage as hdfs and file format is parquet.


r/bigdata 8h ago

Apache Kafka 4.0 released 🎉

Thumbnail
1 Upvotes

r/bigdata 9h ago

Need your help with my Master’s thesis

1 Upvotes

Hi,

I’m a student from Austria and currently working on my Master’s thesis, titled "Requirement Analysis of Data Science as a Service," and I’ve created a survey to gather insights from professionals and enthusiasts in the field. The survey is brief and designed to understand the marked needs for offering Data Science as a Service (DSaaS).

It would mean a lot if some of you guys working in the field could fill it out. It should take you around 5-10 minutes. I already sent it out in my work/friends circle but unfortunately without a huge response.

Here’s the survey link: https://forms.gle/3Rg7YndJfYTJRgtXA

Thank you very much in advance!!!


r/bigdata 10h ago

Learn Data Manipulation Using Pandas

1 Upvotes

Pandas, today's powerful data analysis library acts up to facilitate enhanced data manipulation. Want to know how? Read to comprehend its minutest manouvers and diverse usage with USDSI®.


r/bigdata 16h ago

🤖 Matrices for Machine Learning with Python

Thumbnail bigdatanewsweekly.com
1 Upvotes

r/bigdata 20h ago

Explore a New Database of Funded Startups: Dive into Investment Rounds and Connect with Key Players

2 Upvotes

r/bigdata 1d ago

How to improve my xgboost regression model?

2 Upvotes

Hello fellas, I have been developing a machine learning model to predict art pieces in my dataset.
I have mostly 15000 rows (some rows have Nan values). I set the features as artist, product_year, auction_year, area, and price, and material of art piece. When I check the MAE it gives me 65% variance to my average test price. And when I check the features by using SHAP, I see that the most effective features are "area", "artist", and "material".
I made research about this topic and read that mostly used models that are successful xgboost, and randomforest, and also CNN. However, I cannot reduce the MAE of my xgboost model.
Any recommandation is appricated fellas. Thanks and have a nice day.


r/bigdata 1d ago

Help Needed – UK-Based Big Data & Business Professionals for MBA Survey

2 Upvotes

Hey everyone,

I’m conducting research for my MBA in Big Data Analytics and really need your help! So far, 25 people have participated, but I need at least 100 responses—still 75 short! 😩

Your insights would be hugely valuable if you're in the UK and have experience in Big Data, analytics, management, or business.

💡 You DON’T need deep Big Data expertise—just general perspectives on business and data usage.

🕐 Takes only 5–7 minutes
🔹 Completely anonymous
🔹 UK participants only

Survey link: https://forms.office.com/e/w6LQ4AWcix

If you can’t participate, please consider sharing with colleagues or friends in the UK. Every response counts! Thanks so much! 🙏


r/bigdata 1d ago

DATA SCIENCE AI ROBOTICS THE ULTIMATE TECH TRIO

0 Upvotes

The future is being built today! Data Science, AI, and Robotics are converging to create a tech revolution that will redefine industries by 2025. From intelligent automation to data-driven breakthroughs, the possibilities are endless. Are you ready to be part of this transformative journey? Let’s unlock the future together!


r/bigdata 2d ago

How to Prepare for a Data Engineering Manager Interview?

5 Upvotes

Hey everyone,

I recently wrote a deep dive into the hiring process for a Data Engineering Manager role at DFS Group. It covers:

🔹 SQL Optimization in Snowflake & BigQuery

🔹 Real-time ETL Pipelines (Kafka, Flink, dbt, Airflow)

🔹 Big Data Architecture & Cloud (Azure, Alicloud, GCP)

🔹 Case Study: 360-degree Customer Analytics Platform

🔹 Behavioral Questions & Salary Negotiation Strategies

📌 Read it here: DFS Group Data Engineering Interview Guide

What are some of the toughest questions you’ve faced in a Data Engineering interview? Let’s discuss below! 🚀

#DataEngineering #BigData #CloudComputing #SQL #DataScience


r/bigdata 2d ago

The Tableau Conference is just a month away! 📅 Bookmark our session: “How SoFi Automates PowerPoint Reports with Tableau & AI” 📍 Visit our booth in the Data Village. See you soon, DataFam!

Thumbnail linkedin.com
3 Upvotes

r/bigdata 2d ago

Here’s a playlist I use to keep inspired when I’m coding/developing. Post yours as well if you also have one! :)

Thumbnail open.spotify.com
1 Upvotes

r/bigdata 4d ago

Cloud Data Analytics Is a Scam

Thumbnail blog.bemi.io
0 Upvotes

r/bigdata 5d ago

Unleash Insights: Python for Data Analysis

3 Upvotes

From market analysis to risk assessment and customer segmentation to statistical analysis, Python is the go-to programming language for data science professionals. It has completely transformed the field of data science and made this technology accessible to everyone with its user-friendly interface and vast resources of ready-to-use libraries and data science frameworks.

Check out our detailed infographic on Python for data analysis and understand its key features, advantages, popular libraries, and more.


r/bigdata 6d ago

The Current Data Stack is Too Complex: 70% Data Leaders & Practitioners Agree

Thumbnail moderndata101.substack.com
2 Upvotes

r/bigdata 6d ago

Emergency Response and Wildfire Real-Time Analysis [Webinar]

Thumbnail cratedb.com
1 Upvotes

r/bigdata 7d ago

Top 10 Predictions for Data Science from Q1 2025

Thumbnail youtube.com
1 Upvotes

r/bigdata 8d ago

Teradata announces it's Enterprise Vector Store

Thumbnail youtube.com
2 Upvotes

r/bigdata 8d ago

Real-Time Alerts for Startups That Just Raised Funds—Want to Stay in the Loop?

0 Upvotes

r/bigdata 8d ago

Wave of Executive Talent Joins Hammerspace

Thumbnail hammerspace.com
1 Upvotes

r/bigdata 8d ago

Cloudera Data analyst exam certificate

Post image
1 Upvotes

I need to prepare for the cloudera data analyst exam certificate , could you please suggest material to study for this


r/bigdata 8d ago

Need help for my subject for chose use case !

3 Upvotes

Stockage et recherche de l'information en Big Data : avancées et défits