Our blog

Resources and insights

The latest industry news, interviews, technologies, and resources.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Data Strategy
15
min read

How to Break Down Data Silos in Your Organization

Discover efficient ways to identify and dismantle data silos in your organization, improving collaboration and boosting innovation. Learn strategies like centralizing data, promoting cultural change, and leveraging AI tools.
Matt Turner
March 5, 2025
May 8, 2025
March 5, 2025
May 8, 2025
March 5, 2025
May 8, 2025
Data Strategy
14
min read

The Complete Data Ingestion Guide for Modern Data Strategy

Learn how data ingestion transforms scattered information into powerful insights. This comprehensive guide covers ingestion types, tools, and best practices to overcome common challenges in your data strategy.
Prophecy Team
March 5, 2025
May 1, 2025
March 5, 2025
May 1, 2025
March 5, 2025
May 1, 2025
Data Engineering
9
min read

Data Pipelines: Optimize and Modernize Your Data Strategy

Explore best practices and modern examples in data pipeline strategy. Learn to boost business success with scalable and reliable data solutions.
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
ETL modernization
12
min read

Escape the Legacy ETL Trap and Embrace Modern Pipelines That Deliver

Legacy ETL pipelines can't handle today's AI demands. This guide explains modern approaches, compares ETL vs. ELT architectures, and provides a practical roadmap for modernizing your data transformation strategy.
Prophecy Team
February 21, 2025
May 15, 2025
February 21, 2025
May 15, 2025
February 21, 2025
May 15, 2025
ETL modernization
5
min read

How to Choose the Best ETL Tool: A Comprehensive Buyer's Guide

Explore top ETL tool considerations for seamless data integration, ensuring scalability, security, and cost-effectiveness.
Prophecy Team
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
February 20, 2025
Data Engineering
5
min read

Survey says… GenAI is reshaping data teams

Our new survey shows that data leaders are embracing GenAI and bracing for new challenges
Matt Turner
February 21, 2025
February 21, 2025
February 21, 2025
Events + Announcements
4
min read

3 Ways to Connect with Prophecy at the Gartner Data & Analytics Summit!

Join the Prophecy team in Orlando to see how genAI is reshaping data teams
Mitesh Shah
February 18, 2025
February 18, 2025
February 18, 2025
ETL modernization
15
min read

A Modern Guide to ETL (Extract, Transform, Load) for Data Leaders

Discover how modern ETL powers data extraction, transformation, and loading. Gain insights on real-time processing, cloud-native tools, and business value.
Matt Turner
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
Data Governance
5
min read

12 Must-Have Data Engineering Skills to Transform Your Career

Unlock your career potential with essential data engineering skills. Discover 12 must-have abilities that will transform your professional journey and set you apart in the field.
Mei Long
February 8, 2025
February 14, 2025
February 8, 2025
February 14, 2025
February 8, 2025
February 14, 2025
ETL modernization
7
min read

Unlocking ELT: Enhance Data Integration with Speed and Flexibility

Discover the power of ELT: transform data faster and more flexibly. Learn how this modern approach enhances data integration for improved analytics and insights.
Saurabh Jain
February 6, 2025
April 17, 2025
February 6, 2025
April 17, 2025
February 6, 2025
April 17, 2025
ETL modernization
8
min read

7 Ways AI is Enhancing ETL for Data Leaders

Discover 7 transformative ways AI-powered tools are enhancing ETL, turning routine tasks into business advantages for data leaders.
Matt Turner
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
ETL modernization
11
min read

The Complete Guide To ELT (Extract, Load, Transform) for Data Workflows

Explore how ELT (Extract, Load, Transform) revolutionizes data integration, enabling real-time insights and cost savings with cloud efficiency. Discover more now!
Prophecy Team
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
April 17, 2025
Events + Announcements
5
min read

Prophecy takes in $47M, to scale up and reimagine data integration with AI

Raj Bains
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
January 16, 2025
February 14, 2025
ETL modernization
5
min read

Five Predictions: Data Integration in 2025

The clock strikes noon on Shadow IT
Mitesh Shah
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
January 2, 2025
January 31, 2025
ETL modernization
5
min read

Gliding into the data wonderland

Bringing data teams together for the holidays
Matt Turner
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
December 17, 2024
January 31, 2025
Events + Announcements
5
min read

Data Intelligence and AI Copilots at the Databricks World Tour

Accelerating data transformation with AI to deliver insights
Matt Turner
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
October 31, 2024
January 31, 2025
Events + Announcements
4
min read

Success With AI Takes Data, Big Data!

Prophecy team was out in force at one of the data world’s biggest events
Matt Turner
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
October 2, 2024
January 31, 2025
ETL modernization
4
min read

Weigh Your Options As You Move Off Alteryx

Explore alternatives to Alteryx for modern data prep. Explore options and how Prophecy delivers scalability and openness to modernize data preparation.
Raj Bains
November 18, 2024
November 18, 2024
November 18, 2024
Prophecy for Databricks
5
min read

Load Data into Databricks Delta Lake in 5 Minutes

Discover how Prophecy revolutionizes your data operations.
Shashank Mishra
August 29, 2024
August 29, 2024
August 29, 2024
Events + Announcements
4
min read

Delivering AI and Data Value at CDOIQ 2024

Prophecy attended the CDOIQ Symposium last week in Boston.
Matt Turner
July 25, 2024
July 25, 2024
July 25, 2024
Prophecy for Databricks
6
min read

Airflow and Databricks: Shorten the Learning Curve with Prophecy

Maximize productivity without the complexity.
Pooja Singhal
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
6
min read

Databricks Data + AI Summit 2024: AI Shapes a Copilot Future

Databricks held their annual Data+AI Summit in San Francisco last week at Moscone Center.
Raveena Kapatkar
June 20, 2024
June 20, 2024
June 20, 2024
Events + Announcements
3
min read

AI, Copilot and Authors at Databricks Data and AI Summit 2024

Prophecy’s booth will be hopping with book signings, Copilots, and the latest on data and AI
Matt Turner
January 22, 2025
January 22, 2025
January 22, 2025
Data Integration Platform
4
min read

The Case for Data Transformation Copilots

How copilots will change data transformation, and in the process evolve beyond conversational interfaces
Raj Bains and Maciej Szpakowski
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
June 3, 2024
February 14, 2025
Events + Announcements
5
min read

AI, the Texas Rangers, and Aetion at Databricks Data + AI Summit 2024

Prophecy brings championship winning data, critical healthcare data, and AI for data transformation to DAIS 2024
Matt Turner
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
3
min read

Data engineers and business data users: end the back-and-forth

We’ve written before about the challenge of having too few data engineers. There is another problem. 
Mitesh Shah
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
5
min read

Announcing Prophecy University

Inaugural course addresses the growing data engineering skills gap through agile, self-paced training
Mei Long
April 3, 2024
February 14, 2025
April 3, 2024
February 14, 2025
April 3, 2024
February 14, 2025
Events + Announcements
4
min read

Gartner Data & Analytics Summit 2024 - that’s a wrap!

Johnson & Johnson takes center stage with Prophecy
Ashleigh Blalock
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
March 21, 2024
March 20, 2024
Data Integration Platform
5
min read

Too much data work. Too few data engineers. How to make it scale.

Struggling with data transformation? Hiring more data engineers is not the answer. Learn how low-code data transformation unlocks the full potential of your users and your data.
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
5
min read

Johnson & Johnson Takes Center Stage with Prophecy at Gartner Data & Analytics 2024

Join us in Orlando to witness the future of data transformation
Mitesh Shah
February 13, 2024
February 13, 2024
February 13, 2024
Events + Announcements
3
min read

Webinar spotlight – The future of data transformation

Join our webinar and see why self-service is the future of data transformation, through unified visual & code technology
Mitesh Shah
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
January 16, 2024
Events + Announcements
3
min read

Modern Data’s Stuck

George K. Mathew
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
October 18, 2023
February 14, 2025
Events + Announcements
3
min read

Prophecy at Databricks Data+AI World Tour: Empowering Data Democratization #DAIWT

Join us in this exciting journey and discover how Prophecy's self-service solutions are revolutionizing the data landscape.
Emily Lewis
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
September 29, 2023
October 9, 2023
Events + Announcements
5
min read

Announcing Prophecy Package Builder and Package Hub: Data engineering, standardized.

With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Prophecy Package Builder and Prophecy Package Hub.
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
8
min read

How to build generative AI applications on enterprise data

Discover how to build generative AI applications leveraging enterprise data. Learn to identify use cases, choose effective models, and navigate challenges with our comprehensive guide.
Mei Long
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
5
min read

Prompt engineering vs. fine tuning: Which approach is right for your enterprise generative AI strategy?

In this blog, we'll take a look at the differences between prompt engineering and fine-tuning, and provide insights into each approach
Mitesh Shah
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
3
min read

Enterprise data and the taming of the Generative AI frontier

Companies can train small, domain-specific language models in a matter of hours or days rather than weeks or months provided they have governed and accurate training inputs. 
Kevin Petrie, VP of Research at the Eckerson Group
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
4
min read

SQL models are easy to deploy and orchestrate with Prophecy

Stop getting stuck managing SQL files, start making progress for your business today
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
ETL modernization
6
min read

Understanding ETL Modernization

Everything you need to know to accelerate ETL modernization
Mei Long
March 27, 2025
March 27, 2025
March 27, 2025
Events + Announcements
4
min read

Prophecy and all things Data + AI Summit - that’s a wrap!

Get an exciting recap from Databricks Data + AI summit including Prophecy’s announcements around low-code data engineering and generative AI app development
Emily Lewis
January 22, 2025
January 22, 2025
January 22, 2025
Data Integration Platform
8
min read

How HealthVerity leverages Prophecy for unmatched data privacy and compliance

Mei Long
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
June 27, 2023
February 14, 2025
Data Integration Platform
9
min read

Introducing the Prophecy Generative AI Platform

Build powerful gen AI applications on private enterprise data in just hours
Raj Bains and Maciej Szpakowski
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
Data Integration Platform
5
min read

Introducing Prophecy Data Copilot

Unlock the power of generative AI in data engineering with Prophecy’s Data Copilot.
Mitesh Shah
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
June 22, 2023
February 14, 2025
Events + Announcements
10
min read

Prophecy at Data + AI Summit

Top 10 reasons to visit Prophecy at Data + AI Summit 2023
Emily Lewis
June 16, 2023
June 17, 2023
June 16, 2023
June 17, 2023
June 16, 2023
June 17, 2023
Data Integration Platform
6
min read

Getting started with low-code SQL

Empowering business data users to quickly and easily build scalable data pipelines on the lakehouse
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
ETL modernization
5
min read

3 ways Prophecy modernizes ETL on Databricks

By modernizing the ETL process on Databricks, Prophecy can provide organizations with a more agile, scalable, and cost-effective solution for managing their data.
Maciej Szpakowski
January 13, 2025
February 26, 2025
January 13, 2025
February 26, 2025
January 13, 2025
February 26, 2025
Data Integration Platform
6
min read

How to implement ETL on Apache Spark

Learn key steps to follow, how to define the ETL pipeline using Spark APIs and dataframes, and best practices for testing and optimizing pipelines for maximum efficiency
Mei Long
May 16, 2024
May 16, 2024
May 16, 2024
Events + Announcements
3
min read

Event spotlight: Prophecy at Data + AI Summit

Bringing the power of low-code data engineering to the masses
Emily Lewis
May 16, 2024
May 16, 2024
May 16, 2024
Data Integration Platform
5
min read

Hitting data driven home runs: How the Texas Rangers win by harnessing Prophecy in their data mesh architecture

Learn how the Texas Rangers use Prophecy and Databricks Lakehouse as the foundation of their data mesh architecture to gain a competitive advantage with low-code data engineering.
Alexander Booth
February 14, 2025
February 14, 2025
February 14, 2025
Data Integration Platform
11
min read

Empower all business data users with interactive SQL development

Leverage Prophecy’s low-code approach and integration with dbt Core to build SQL data pipelines without compromising on engineering best practices
Anya Bida
February 14, 2025
February 14, 2025
February 14, 2025
Events + Announcements
5
min read

Announcing Prophecy 3.0: low-code SQL transformations

Discover how Prophecy 3.0 arms all data users with low-code SQL, so they can quickly and easily build scalable data pipelines, resulting in highly impactful data products.
Maciej Szpakowski
April 26, 2023
February 14, 2025
April 26, 2023
February 14, 2025
April 26, 2023
February 14, 2025
ETL modernization
7
min read

From novice to expert: A blueprint for data analysts to build robust data transformation pipelines without relying on engineering

Learn essential skills and techniques to empower non-technical data practitioners to build ETL pipelines without relying on data engineering.
Mei Long
May 30, 2023
May 30, 2023
May 30, 2023
Prophecy for Databricks
3
min read

Data engineering for the data lakehouse: Four guiding principles

A rising number of enterprises are adopting the lakehouse to unite their analytics projects and foster innovation on a shared, cloud-based platform.
Kevin Petrie, VP of Research at the Eckerson Group
May 29, 2023
June 2, 2023
May 29, 2023
June 2, 2023
May 29, 2023
June 2, 2023
Events + Announcements
8
min read

Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs

Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Emily Lewis
May 28, 2023
June 8, 2023
May 28, 2023
June 8, 2023
May 28, 2023
June 8, 2023
Data Integration Platform
2
min read

Getting started with low-code

Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Anya Bida
June 8, 2023
June 8, 2023
June 8, 2023
Data Integration Platform
15
min read

PySpark hands-on tutorial using a visual IDE

Let's get started with PySpark using a visual interface to generate open-source Spark code.
Anya Bida
May 16, 2024
May 16, 2024
May 16, 2024
OSZAR »