Fetch spark job jar from Nexus

mottosan

Is it possible to get spark to fetch the primaryResource jar from Nexus given the maven coordinates for it? I know it is possible to fetch dependencies from Nexus, but it doesn't appear to be possible to fetch the job jar from Nexus. I'm wondering if anyone else has tried it or has a workaround for the same. Thanks.

mottosan

Looks like spark-submit works with just --packages and --repositories and a dummy primaryResource.

The example:

--packages someGroupId:someArtifactId:someVersion \
--repositories http://nexus.company.com/nexus nonExistentFakeName.jar

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

From Dev

How to upload a jar file to ooyala-spark job server from java

From Dev

Package jar from Nexus using Assembly plugin

From Dev

Configure Play 2.1 to fetch a privately hosted artefact from local Nexus

From Dev

Spark - Call Spark jar from java with arguments

From Dev

guava jar conflict when using ElasticSearch on Spark job

From Dev

K8s Spark Job JAR params

From Dev

guava jar conflict when using ElasticSearch on Spark job

From Dev

Run Spark Job via Uber Jar with Oozie and Hue

From Dev

Unable to deploy jar from a Spring Boot application to Nexus/Artifactory

From Dev

Launch spark job on-demand from code

From Dev

Scheduling a Spark Job from a NodeJS or Play! Server

From Dev

How to exclude nodes from Spark cluster job?

From Dev

Create Snapshot of FS from Spark Job

From Dev

Inconsistent outputs from Scala Spark and pyspark job

From Dev

Spark not able to fetch events from Amazon Kinesis

From Dev

Maven dependency to jar in Nexus

From Dev

Rails Fetch record from instagram using cron job

From Dev

Excluding spark from uber jar with maven

From Dev

Triggering specific class from .jar file for cron job?

From Dev

How to fetch Spark Streaming job statistics using REST calls when running in yarn-cluster mode

From Dev

Nexus takes jar from maven central, not from 3rd party

From Dev

Artifactory or Nexus deploy Jar and Pom

From Dev

How to submit spark job from within java program to standalone spark cluster without using spark-submit?

From Dev

Calling JDBC to impala/hive from within a spark job and creating a table

From Dev

Output from Dataproc Spark job in Google Cloud Logging

From Dev

Delta table versioning while writing from a Spark structured streaming job

From Dev

Spark: fetch data from complex dataframe schema with map

From Dev

Fetch data from ES and save to HDFS as Avro (Spark)

From Dev

Dynamically fetch value from hashmap during select spark scala

Related Related

  1. 1

    How to upload a jar file to ooyala-spark job server from java

  2. 2

    Package jar from Nexus using Assembly plugin

  3. 3

    Configure Play 2.1 to fetch a privately hosted artefact from local Nexus

  4. 4

    Spark - Call Spark jar from java with arguments

  5. 5

    guava jar conflict when using ElasticSearch on Spark job

  6. 6

    K8s Spark Job JAR params

  7. 7

    guava jar conflict when using ElasticSearch on Spark job

  8. 8

    Run Spark Job via Uber Jar with Oozie and Hue

  9. 9

    Unable to deploy jar from a Spring Boot application to Nexus/Artifactory

  10. 10

    Launch spark job on-demand from code

  11. 11

    Scheduling a Spark Job from a NodeJS or Play! Server

  12. 12

    How to exclude nodes from Spark cluster job?

  13. 13

    Create Snapshot of FS from Spark Job

  14. 14

    Inconsistent outputs from Scala Spark and pyspark job

  15. 15

    Spark not able to fetch events from Amazon Kinesis

  16. 16

    Maven dependency to jar in Nexus

  17. 17

    Rails Fetch record from instagram using cron job

  18. 18

    Excluding spark from uber jar with maven

  19. 19

    Triggering specific class from .jar file for cron job?

  20. 20

    How to fetch Spark Streaming job statistics using REST calls when running in yarn-cluster mode

  21. 21

    Nexus takes jar from maven central, not from 3rd party

  22. 22

    Artifactory or Nexus deploy Jar and Pom

  23. 23

    How to submit spark job from within java program to standalone spark cluster without using spark-submit?

  24. 24

    Calling JDBC to impala/hive from within a spark job and creating a table

  25. 25

    Output from Dataproc Spark job in Google Cloud Logging

  26. 26

    Delta table versioning while writing from a Spark structured streaming job

  27. 27

    Spark: fetch data from complex dataframe schema with map

  28. 28

    Fetch data from ES and save to HDFS as Avro (Spark)

  29. 29

    Dynamically fetch value from hashmap during select spark scala

HotTag

Archive