Skip to content

Add Spark 4.1.0-preview4 news #650

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dongjoon-hyun merged 1 commit into from
Nov 20, 2025
Merged

Add Spark 4.1.0-preview4 news #650

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions news/_posts/2025-11-19-spark-4-1-0-preview4-released.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
---
layout: post
title: Preview release of Spark 4.1.0
categories:
- News
tags: []
status: publish
type: post
published: true
meta:
_edit_last: '4'
_wpas_done_all: '1'
---
To enable wide-scale community testing of the upcoming Spark 4.1.0 release, the Apache Spark community has posted a
<a href="https://dist.apache.org/repos/dist/release/spark/spark-4.1.0-preview4">Spark 4.1.0-preview4 release</a>.
This preview is not a stable release in terms of either API or functionality, but it is meant to give the community early
access to try the code that will become Spark 4.1.0. If you would like to test the release,
please <a href="https://dist.apache.org/repos/dist/release/spark/spark-4.1.0-preview4">download</a> it, and send feedback using either
<a href="https://spark.apache.org/community.html">mailing lists</a> or
<a href="https://issues.apache.org/jira/browse/SPARK/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel">JIRA</a>.
The documentation is available at the <a href="https://spark.apache.org/docs/4.1.0-preview4/">link</a>.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you.
6 changes: 3 additions & 3 deletions site/404.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -178,6 +178,9 @@ <h2 id="oops">Oops!</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -187,9 +190,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/committers.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -729,6 +729,9 @@ <h3>Policy on backporting bug fixes</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -738,9 +741,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/community.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -334,6 +334,9 @@ <h3>Powered by</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -343,9 +346,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/contributing.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -721,6 +721,9 @@ <h2>Code of conduct</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -730,9 +733,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/developer-tools.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -707,6 +707,9 @@ <h2>Generative tooling usage</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -716,9 +719,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/documentation.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -166,6 +166,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -175,9 +178,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/downloads.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -218,6 +218,9 @@ <h3 id="archived-releases">Archived releases</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -227,9 +230,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/error-message-guidelines.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -555,6 +555,9 @@ <h4 id="wording-guide">Wording guide</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -564,9 +567,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/examples.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -503,6 +503,9 @@ <h2>Additional examples</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -512,9 +515,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/faq.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -225,6 +225,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -234,9 +237,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/graphx/index.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -270,6 +270,9 @@ <h3>Getting started</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -279,9 +282,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/history.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -188,9 +191,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/improvement-proposals.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -251,6 +251,9 @@ <h4>Implementing an SPIP</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -260,9 +263,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/mailing-lists.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -163,6 +163,9 @@
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -172,9 +175,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/mllib/index.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -316,6 +316,9 @@ <h3>Getting started</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -325,9 +328,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/news/3-1-3-released.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -169,6 +169,9 @@ <h2>Spark 3.1.3 released</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -178,9 +181,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/news/amp-camp-2013-registration-ope.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -169,6 +169,9 @@ <h2>Registration open for AMP Camp training camp in Berkeley</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -178,9 +181,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/news/announcing-the-first-spark-summit.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -173,6 +173,9 @@ <h2>Announcing the first Spark Summit: December 2, 2013</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4-1-0-preview4-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Nov 19, 2025)</span></li>

<li><a href="/news/spark-4-1-0-preview3-released.html">Preview release of Spark 4.1.0</a>
<span class="small">(Oct 29, 2025)</span></li>

Expand All @@ -182,9 +185,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-5-7-released.html">Spark 3.5.7 released</a>
<span class="small">(Sep 24, 2025)</span></li>

<li><a href="/news/spark-4-0-1-released.html">Spark 4.0.1 released</a>
<span class="small">(Sep 06, 2025)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
Loading