The Apache Software Foundation Announces Apache Spark as a Top-Level Project
>> this announcement is also available online at http://s.apache.org/Op0
Super-fast, Open Source large-scale data processing and advanced analytics engine in use at
Alibaba, Cloudera, Databricks, IBM, Intel, and Yahoo, among others
Forest Hill, MD –27 February 2014– The Apache Software Foundation (ASF), the all-volunteer
developers, stewards, and incubators of more than 170 Open Source projects and initiatives,
announced today that Apache Spark has graduated from the Apache Incubator to become a Top-Level
Project (TLP), signifying that the project's community and products have been well-governed
under the ASF's meritocratic process and principles.
Apache Spark is an Open Source cluster computing framework for fast and flexible large-scale
data analysis. Dubbed a "Hadoop Swiss Army knife" by The Register, Spark is recognized for
its remarkable speed and ease of use, running programs up to 100x faster than Apache Hadoop
MapReduce in memory, and with APIs that allow developers to quickly write applications in
Java, Python, or Scala.
"It's great to see Apache become Spark’s permanent home," said Matei Zaharia, Vice President
of Apache Spark. "Spark has quickly become one of the most active projects in the Hadoop ecosystem,
with dozens of organizations contributing, and we look forward to working closely with the
rest of the Apache community."
Initially created in 2009 at the University of California at Berkeley's AMPLab (the research
center also responsible for the original development of Apache Mesos), the Spark distributed
computing framework for advanced analytics in Apache Hadoop can easily be used standalone
or on Hadoop YARN, EC2 or Mesos. Integrated with Apache Hadoop, Spark is well suited for machine
learning, interactive queries, and stream processing, and can read from HDFS, HBase, Cassandra,
as well as any Hadoop data source.
"This is a major milestone for the students and researchers in the AMPLab," said Mike Franklin,
Director of the AMPLab at UC Berkeley. "Spark demonstrates the real impact that research can
have and validates the support AMPLab has received from our White House-announced NSF Expeditions
in Computing Award and our 20+ industrial sponsors and collaborators."
"Through our work on Spark at both AMPLab and Databricks, we’ve focused on making it much
easier for organizations to get insights from big data," said Ion Stoica, CEO at Databricks
and Professor at UC Berkeley. "We're doing this together with a fantastic open source community.
We look forward to continue working with the community to accelerate the development and adoption
of Apache Spark."
Since entering the Apache Incubator in June 2013, Apache Spark bolstered its community through
code contributions by more than 120 developers from 25 organizations. Apache Spark is in use
at an array of global corporations that include Alibaba, Cloudera, Databricks, IBM, Intel,
and Yahoo, among others.
Andrew Feng, Distinguished Architect at Yahoo, said "Yahoo has played a leading role in evolving
Hadoop and related big-data technologies, including Spark. While Apache Hadoop serves as the
foundation of our big-data platform, Spark is an attractive technology for iterative applications
such as machine learning. Yahoo has made significant contributions to the development of Spark
and we congratulate Spark on becoming an Apache top-level project."
"I'm really proud of the community aspect that has become infectious in Apache Spark and that
really grew out of the energy in the project starting in the AMP Lab and through its movement
to the ASF," said Chris Mattmann, Apache Spark Incubator Mentor at the ASF, and Chief Architect,
Instrument and Science Data Systems Section at NASA JPL. "Matei, Patrick, Reynold, and many
of the leaders of the project have really done a tremendous job and I'm excited to see the
next generation of Hadoop-style systems have a home at the ASF."
"We have some very exciting features coming in the next months, so stay tuned for even more
powerful versions of Spark," added Zaharia.
Availability and Oversight
As with all Apache products, Apache Spark software is released under the Apache License v2.0,
and is overseen by a self-selected team of active contributors to the project. A Project Management
Committee (PMC) guides the Project's day-to-day operations, including community development
and product releases. For documentation and ways to become involved with Apache Spark, visit
About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than one hundred and seventy
leading Open Source projects, including Apache HTTP Server --the world's most popular Web
server software. Through the ASF's meritocratic process known as "The Apache Way," more than
400 individual Members and 3,500 Committers successfully collaborate to develop freely available
enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions
are distributed under the Apache License; and the community actively participates in ASF mailing
lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings,
and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations
and corporate sponsors including Budget Direct, Citrix, Cloudera, Comcast, Facebook, Google,
Hortonworks, HP, Huawei, IBM, InMotion Hosting, Matt Mullenweg, Microsoft, Pivotal, Produban,
WANdisco, and Yahoo.
For more information, visit http://www.apache.org/ or follow @TheASF on Twitter.
"Apache", "Spark", "Apache Spark", and "ApacheCon" are trademarks of The Apache Software Foundation.
All other brands and trademarks are the property of their respective owners.
# # #
NOTE: you are receiving this message because you are subscribed to the firstname.lastname@example.org
distribution list. To unsubscribe, send email from the recipient account to email@example.com
with the word "Unsubscribe" in the subject line.
The MySQL 5.6 Release Candidate is an aggregation of the previous MySQL 5.6 Development Milestone Releases (DMR) and provides a true functio... čítať viac
MySQL Thread Pool has now been updated for the MySQL 5.6 version. Obviously, with the much higher concurrency of the MySQL Server in 5.6 its... čítať viac
MySQL is the most trusted and depended-on open source database platform in use today. As such, 9 out of the top 10 most popular and highly-t... čítať viac
To support the growing emphasis on real-time operations, MySQL is releasing a new MySQL Applier for Hadoop to enable the replication of even... čítať viac
The MySQL team at Oracle are excited to announce the immediate availability of the MySQL Cluster 7.3 Development Milestone Release GA releas... čítať viac
Learn how easy it is to deploy a MySQL Cluster database that has been configured to best meet your applications needs within your environmen... čítať viac
Learn how to use MySQL 5.6 and the MySQL Utilities to setup, monitor and manage your MySQL replication topology. See how a single command ca... čítať viac
The new MySQL 5.6.5 Development Milestone Release (DMR) introduces a much anticipated feature - Global Transaction Identifiers (GTIDs) for M... čítať viac
Joomla extension Password Policy (Joomla). Password Policy Plugin extends the password policy defined by Joomla!.FeaturesMaximum password ag... čítať viac
Je dostupné nové rozšírenie pre redakčný systém Joomla pod názvom EXT bxSlider Products for redSHOP (Joomla). Module slider products for red... čítať viac
Je dostupné nové rozšírenie pre redakčný systém Joomla pod názvom Popunder Popup (Joomla). Pop-under popup is a plugin to load window behind... čítať viac
The Apache Ignite Community is pleased to announce the release of ApacheIgnite 2.5.0.Apache Ignite  is a memory-centr... čítať viac
Joomla extension Improved Registration (Joomla). Joomla different user group on registrationWith Improved Registration you can manage Joomla... čítať viac
Je dostupné nové rozšírenie pre redakčný systém Joomla pod názvom Chained Fields for K2 (Joomla). It is a package to enable creating chained... čítať viac
Joomla extension Avalara AvaTax Connector for HikaShop (Joomla). The Avalara-certified AvaTax Connector works with your HikaShop or HikaMark... čítať viac
Joomla extension Registration with Motioncaptcha (Joomla). This Plugin overrides the Joomla Registration View without touching or changing C... čítať viac