Skip to content

Commit e2f40fe

Browse files
Release for azure-cosmos-spark_3-1_2-12 V4.4.1 (Azure#25375)
1 parent e46b467 commit e2f40fe

File tree

13 files changed

+26
-15
lines changed

13 files changed

+26
-15
lines changed

eng/jacoco-test-coverage/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -174,7 +174,7 @@
174174
<dependency>
175175
<groupId>com.azure</groupId>
176176
<artifactId>azure-cosmos</artifactId>
177-
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
177+
<version>4.22.0-snapshot.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
178178
</dependency>
179179
<dependency>
180180
<groupId>com.azure</groupId>

eng/versioning/version_client.txt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -75,10 +75,10 @@ com.azure:azure-core-serializer-json-gson;1.1.8;1.2.0-beta.1
7575
com.azure:azure-core-serializer-json-jackson;1.2.9;1.3.0-beta.1
7676
com.azure:azure-core-test;1.7.4;1.8.0-beta.1
7777
com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.16;1.0.0-beta.17
78-
com.azure:azure-cosmos;4.21.0;4.22.0-beta.1
78+
com.azure:azure-cosmos;4.21.0;4.22.0-snapshot.1
7979
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
8080
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
81-
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.5.0-beta.1;4.5.0-beta.1
81+
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.4.1;4.4.1
8282
com.azure:azure-cosmos-encryption;1.0.0-beta.9;1.0.0-beta.10
8383
com.azure:azure-data-appconfiguration;1.2.4;1.3.0-beta.1
8484
com.azure:azure-data-appconfiguration-perf;1.0.0-beta.1;1.0.0-beta.1

sdk/cosmos/azure-cosmos-benchmark/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ Licensed under the MIT License.
4343
<dependency>
4444
<groupId>com.azure</groupId>
4545
<artifactId>azure-cosmos</artifactId>
46-
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
46+
<version>4.22.0-snapshot.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
4747
</dependency>
4848

4949
<dependency>

sdk/cosmos/azure-cosmos-dotnet-benchmark/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ Licensed under the MIT License.
4242
<dependency>
4343
<groupId>com.azure</groupId>
4444
<artifactId>azure-cosmos</artifactId>
45-
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
45+
<version>4.22.0-snapshot.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
4646
</dependency>
4747

4848
<dependency>

sdk/cosmos/azure-cosmos-encryption/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ Licensed under the MIT License.
4444
<dependency>
4545
<groupId>com.azure</groupId>
4646
<artifactId>azure-cosmos</artifactId>
47-
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
47+
<version>4.22.0-snapshot.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
4848
</dependency>
4949

5050
<dependency>

sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,8 @@
11
## Release History
2-
### 4.5.0-beta.1 (Unreleased)
2+
3+
### 4.4.1 (2021-11-12)
4+
#### Key Bug Fixes
5+
* Fixed an issue that can cause large delays before read or write operations start for large Cosmos DB container
36

47
### 4.4.0 (2021-11-10)
58
#### New Features

sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2626

2727
| Connector | Minimum Spark Version | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
2828
| ------------- | --------------------- | -------------------- | ----------------------- | ----------------------------- |
29+
| 4.4.1 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
2930
| 4.4.0 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
3031
| 4.3.1 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
3132
| 4.3.0 | 3.1.1 | 8 | 2.12 | 8.\*, 9.\* |
@@ -39,11 +40,11 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
3940
### Download
4041

4142
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
42-
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.4.0`
43+
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.4.1`
4344

4445
You can also integrate against Cosmos DB Spark Connector in your SBT project:
4546
```scala
46-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.4.0"
47+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.4.1"
4748
```
4849

4950
Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).

sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212

1313
<groupId>com.azure.cosmos.spark</groupId>
1414
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
15-
<version>4.5.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
15+
<version>4.4.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
1616
<packaging>jar</packaging>
1717
<name>OLTP Spark Connector for Azure Cosmos DB SQL API</name>
1818
<description>OLTP Spark Connector for Azure Cosmos DB SQL API</description>
@@ -61,7 +61,7 @@
6161
<dependency>
6262
<groupId>com.azure</groupId>
6363
<artifactId>azure-cosmos</artifactId>
64-
<version>4.22.0-beta.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
64+
<version>4.22.0-snapshot.1</version> <!-- {x-version-update;com.azure:azure-cosmos;current} -->
6565
</dependency>
6666
<dependency>
6767
<groupId>org.scala-lang.modules</groupId>

sdk/cosmos/azure-cosmos-spark_3-1_2-12/src/main/scala/com/azure/cosmos/spark/SparkUtils.scala

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,12 @@ private object SparkUtils {
3434
}
3535

3636
def safeOpenConnectionInitCaches(container: CosmosAsyncContainer, logger: (String, Exception) => Unit): Unit = {
37+
38+
// TODO @fabianm - uncomment and fix or completely remove this code
39+
// the version below can cause perf problems whenever there is data available in
40+
// a container already and when the container does not index all properties
41+
// because the query below will result in a full table scan (vs. index lookup only)
42+
/*
3743
try {
3844
3945
// this results in a cross partition query with one single query plan request
@@ -54,6 +60,7 @@ private object SparkUtils {
5460
logger("ignoring openConnectionsAndInitCaches failure", e)
5561
}
5662
}
63+
*/
5764
}
5865

5966
private object DaemonThreadFactory {

sdk/cosmos/azure-cosmos/CHANGELOG.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
## Release History
22

3-
### 4.22.0-beta.1 (Unreleased)
3+
### 4.22.0-snapshot.1 (Unreleased)
44

55
#### Features Added
66

0 commit comments

Comments
 (0)