之前使用ES的时候建表Type时有个字段的类型搞错了。以至于用API查询时出错。所以就研究一下ES API做了一下ES批量导出和导入重构了Type

1:Java API批量导出

 Settings settings = ImmutableSettings.settingsBuilder().put("cluster.name", "elasticsearch-bigdata").build();          Client client = new TransportClient(settings)                  .addTransportAddress(new InetSocketTransportAddress("10.58.71.6", 9300));   SearchResponse response = client.prepareSearch("bigdata").setTypes("student")                 .setQuery(QueryBuilders.matchAllQuery()).setSize(10000).setScroll(new TimeValue(6000                  00))                  .setSearchType(SearchType.SCAN).execute().actionGet();//setSearchType(SearchType.Scan) 告诉ES不需要排序只要结果返回即可 setScroll(new TimeValue(600000)) 设置滚动的时间          String scrollid = response.getScrollId();          try {          //把导出的结果以JSON的格式写到文件里              BufferedWriter out = new BufferedWriter(new FileWriter("es", true));                            //每次返回数据10000条。一直循环查询直到所有的数据都查询出来              while (true) {                  SearchResponse response2 = client.prepareSearchScroll(scrollid).setScroll(new TimeValue(1000000))                          .execute().actionGet();                  SearchHits searchHit = response2.getHits();                  //再次查询不到数据时跳出循环                  if (searchHit.getHits().length == 0) {                      break;                  }                  System.out.println("查询数量 ：" + searchHit.getHits().length);                  for (int i = 0; i < searchHit.getHits().length; i++) {                      String json = searchHit.getHits()[i].getSourceAsString();                      out.write(json);                      out.write("\r\n");                  }              }              System.out.println("查询结束");              out.close();          } catch (FileNotFoundException e) {              // TODO Auto-generated catch block              e.printStackTrace();          } catch (IOException e) {              // TODO Auto-generated catch block              e.printStackTrace();          }

2：Java API 批量导入

Settings settings = ImmutableSettings.settingsBuilder().put("cluster.name", "elasticsearch-bigdata").build();          Client client = new TransportClient(settings)                  .addTransportAddress(new InetSocketTransportAddress("10.58.71.6", 9300));          try {          //读取刚才导出的ES数据              BufferedReader br = new BufferedReader(new FileReader("es"));              String json = null;              int count = 0;              //开启批量插入              BulkRequestBuilder bulkRequest = client.prepareBulk();              while ((json = br.readLine()) != null) {                  bulkRequest.add(client.prepareIndex("bigdata", "student").setSource(json));                  //每一千条提交一次                  if (count% 1000==0) {                      bulkRequest.execute().actionGet();                      System.out.println("提交了：" + count);                  }                  count++;              }              bulkRequest.execute().actionGet();              System.out.println("插入完毕");              br.close();          } catch (FileNotFoundException e) {              e.printStackTrace();          } catch (IOException e) {              // TODO Auto-generated catch block              e.printStackTrace();          }

 以上就是ES的批量导出和导入了。

来自： http://my.oschina.net/chiyong/blog/552622