Answers for "spark elasticsearch configuration"

0

adding new field in existing kibana index using spark java

String json1 = "{"reason" : "business","airport" : "SFO"}";  
String json2 = "{"participants" : 5,"airport" : "OTP"}";

JavaSparkContext jsc = ...
JavaRDD<String> stringRDD = jsc.parallelize(ImmutableList.of(json1, json2)); 
JavaEsSpark.saveJsonToEs(stringRDD, "spark/json-trips");
Posted by: Guest on September-01-2020
0

read from elasticsearch in spark

...
import org.elasticsearch.spark._

...
val conf = ...
val sc = new SparkContext(conf)

sc.esRDD("radio/artists", "?q=me*")
Posted by: Guest on June-02-2020
0

adding new field in existing kibana index using spark java

val game = Map(
  "media_type"->"game", 
      "title" -> "FF VI",
       "year" -> "1994")
val book = Map("media_type" -> "book","title" -> "Harry Potter","year" -> "2010")
val cd = Map("media_type" -> "music","title" -> "Surfing With The Alien")

sc.makeRDD(Seq(game, book, cd)).saveToEs("my-collection-{media_type}/doc")
Posted by: Guest on September-01-2020

Code answers related to "Java"

Java Answers by Framework

Browse Popular Code Answers by Language