Your browser is out of date

Update your browser to view this website correctly. Update my browser now

×

Apache Spark™

Apache Spark is the open standard for flexible in-memory data processing that enables batch, real-time, and advanced analytics on the Apache Hadoop platform. Cloudera is committed to helping the ecosystem adopt Spark as the default data execution engine for analytic workloads.

Try now

Easy, Productive Development

Simple, yet rich, APIs for Java, Scala, and Python open up data for interactive discovery and iterative development of applications. Through shared common code, data scientists and developers can increase productivity with rapid prototyping for batch and streaming applications, using the language and third-party tools on which they already rely.

Explore the Developer Guide for Spark


Fast Processing

Take advantage of Spark’s distributed in-memory storage for high performance processing across a variety of use cases, including batch processing, real-time streaming, and advanced modeling and analytics. With significant performance improvements over MapReduce, Spark is the tool of choice for data scientists and analysts to turn their data into real results.

Demystifying Spark Jobs to Optimize for Cost and Performance

Close up of pen pointing to graph on screen
Diagram of Spark's benefits

Integrated across the platform

As an integrated part of Cloudera’s platform, Spark benefits from unified resource management (through YARN), simple administration (through Cloudera Manager), and compliance-ready security and governance (through Apache Sentry and Cloudera Navigator) — all critical for running in production.

Learn more


The Cloudera difference for Apache Spark

The first integrated solution to support Apache Spark, Cloudera not only has the most experience — with production customers across industries — but also has built the deepest engineering integration between Spark and the rest of the ecosystem, including bringing Spark to YARN and adding necessary security and management integrations (500+ patches contributed, to date).

Cloudera also has multiple Spark committers on staff, so you get direct access and influence to the roadmap based on your needs and use cases.

IQVIA customer success story

Video: Spark in the Enterprise, 2 Years Later

Close up of man typing on laptop

Partnered with the ecosystem

Seamlessly integrate with the tools your data scientists and developers are already using by leveraging Cloudera’s 1,700+ partner ecosystem. With a robust partner certification program and a dedicated Spark Partner Accelerator program, we are continuously working to build out production-hardened integrations between Spark and the most popular third-party tools.

Learn more about our partners

Expert support for Apache Spark

Cloudera has Spark experts across the globe, for world-class support 24/7. With more experience across more customers, for more use cases, Cloudera is the leader in Spark support so you can focus on results.

Crew team rowing a boat

Your form submission has failed.

This may have been caused by one of the following:

  • Your request timed out
  • A plugin/browser extension blocked the submission. If you have an ad blocking plugin please disable it and close this message to reload the page.