elasticsearch从入门到入门系列（三）搜索大汇总

1.term的多种查询

• 介绍&＃xff1a;
  • 单词级别的查询
  • 这些查询通常用于结构化的查询&＃xff0c;比如&＃xff1a;number,date,keyword等&＃xff0c;而不是text
  • 也就是说&＃xff0c;全⽂本查询之前要先对⽂本内容进⾏分词&＃xff0c;⽽单词级别的查询直接在相应字段的
    反向索引中精确查找&＃xff0c;单词级别的查询⼀般⽤于数值、⽇期等类型的字段上
• Term Query精确匹配查询(查找号码为23的球员)

请求&＃xff1a;POST nba/_search{"query": {"term": {"jerseyNo": "23"}}}

• Exsit Query 在特定的字段中查找⾮空值的⽂档(查找队名⾮空的球员)

请求&＃xff1a;POST nba/_search{"query": {"exists": {"field": "teamNameEn"}}}

• Prefix Query 查找包含带有指定前缀term的⽂档(查找队名以Rock开头的球员)

请求&＃xff1a;POST nba/_search{"query":{"prefix":{"teamNameEn" : "Rock"}}}

• Wildcard Query ⽀持通配符查询&＃xff0c;*表示任意字符&＃xff0c;?表示任意单个字符(查找⽕箭队的球员)

POST nba/_search{"query": {"wildcard": {"teamNameEn": "Ro*s"}}
}

• Regexp Query 正则表达式查询(查找⽕箭队的球员)

POST nba/_search{"query": {"regexp": {"teamNameEn": "Ro.*s"}}
}

• Ids Query(查找id为1和2的球员)

POST nba/_search{"query": {"ids": {"values": [1, 2]}}
}

2.es的范围搜索

• 查找指定字段在指定范围内包含值&＃xff08;⽇期、数字或字符串&＃xff09;的⽂档。
  • 查找在nba打了2年到10年以内的球员

POST nba/_search{"query": {"range": {"playYear": {"gte": 2, "lte": 10}}}
}

3.es的布尔查询

• 布尔查询

• must(查找名字叫做james的球员)

POST /nba/_search{"query": {"bool": {"must": [{"match": {"displayNameEn": "james"}}]}}
}

• 效果同must&＃xff0c;但是不打分(查找名字叫做James的球员)

POST /nba/_search{"query": {"bool": {"filter": [{"match": {"displayNameEn": "james"}}]}}
}

• must_not (查找名字叫做James的⻄部球员)

POST /nba/_search{"query": {"bool": {"must": [{"match": {"displayNameEn": "james"}}], "must_not": [{"term": {"teamConferenceEn": {"value": "Eastern"}}}]}}
}


• should(查找名字叫做James的打球时间应该在11到20年⻄部球员)
  • 即使匹配不到也返回&＃xff0c;只是评分不同

POST /nba/_search{"query": {"bool": {"must": [{"match": {"displayNameEn": "james"}}], "must_not": [{"term": {"teamConferenceEn": {"value": "Eastern"}}}], "should": [{"range": {"playYear": {"gte": 11, "lte": 20}}}]}}
}

• 如果minimum_should_match&＃61;1&＃xff0c;则变成要查出名字叫做James的打球时间在11到20年⻄部 球员

POST /nba/_search{"query": {"bool": {"must": [{"match": {"displayNameEn": "james"}}], "must_not": [{"term": {"teamConferenceEn": {"value": "Eastern"}}}], "should": [{"range": {"playYear": {"gte": 11, "lte": 20}}}], "minimum_should_match": 1}}
}

4.es的排序查询

• ⽕箭队中按打球时间从⼤到⼩排序的球员

POST nba/_search{"query": {"match": {"teamNameEn": "Rockets"}}, "sort": [{"playYear": {"order": "desc"}}]
}

• ⽕箭队中按打球时间从⼤到⼩&＃xff0c;如果年龄相同则按照身⾼从⾼到低排序的球员

POST nba/_search{"query": {"match": {"teamNameEn": "Rockets"}}, "sort": [{"playYear": {"order": "desc"}}, {"heightValue": {"order": "asc"}}]
}

5.es聚合查询之指标聚合

• ES聚合分析是什么
  • 聚合分析是数据库中重要的功能特性&＃xff0c;完成对⼀个查询的数据集中数据的聚合计算&＃xff0c;如&＃xff1a;找 出某字段&＃xff08;或计算表达式的结果&＃xff09;的最⼤值、最⼩值&＃xff0c;计算和、平均值等。ES作为搜索引擎 兼数据库&＃xff0c;同样提供了强⼤的聚合分析能⼒。
  • 对⼀个数据集求最⼤、最⼩、和、平均值等指标的聚合&＃xff0c;在ES中称为指标聚合
  • ⽽关系型数据库中除了有聚合函数外&＃xff0c;还可以对查询出的数据进⾏分组group by&＃xff0c;再在组上 进⾏指标聚合。在ES中称为桶聚合
• max min sum avg
  • 求出火箭队球员的平均年龄

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"avgAge": {"avg": {"field": "age"}}}, "size": 0
}

• value_count 统计⾮空字段的⽂档数
  • 求出⽕箭队中球员打球时间不为空的数量

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"countPlayerYear": {"value_count": {"field": "playYear"}}}, "size": 0
}

• 查出⽕箭队有多少名球员

POST nba/_count{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}
}

• Cardinality 值去重计数
  • 查出⽕箭队中年龄不同的数量

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"counAget": {"cardinality": {"field": "age"}}}, "size": 0
}


• stats 统计count max min avg sum 5个值
  • 查出⽕箭队球员的年龄stats

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"statsAge": {"stats": {"field": "age"}}}, "size": 0
}

• Extended stats ⽐stats多4个统计结果&＃xff1a; 平⽅和、⽅差、标准差、平均值加/减两个标准差的区间
  • 查出⽕箭队球员的年龄Extend stats

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"extendStatsAge": {"extended_stats": {"field": "age"}}}, "size": 0
}


• Percentiles 占⽐百分位对应的值统计&＃xff0c;默认返回[ 1, 5, 25, 50, 75, 95, 99 ]分位上的值
  • 查出⽕箭的球员的年龄占⽐

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"pecentAge": {"percentiles": {"field": "age"}}}, "size": 0
}

• 查出⽕箭的球员的年龄占⽐(指定分位值)

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"percentAge": {"percentiles": {"field": "age", "percents": [20, 50, 75]}}}, "size": 0
}

6.es聚合查询之桶聚合

• Terms Aggregation 根据字段项分组聚合
  • ⽕箭队根据年龄进⾏分组

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"aggsAge": {"terms": {"field": "age", "size": 10}}}, "size": 0
}

• order 分组聚合排序
  • ⽕箭队根据年龄进⾏分组&＃xff0c;分组信息通过年龄从⼤到⼩排序 (通过指定字段)

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"aggsAge": {"terms": {"field": "age", "size": 10, "order": {"_key": "desc"}}}}, "size": 0
}


• ⽕箭队根据年龄进⾏分组&＃xff0c;分组信息通过⽂档数从⼤到⼩排序 (通过⽂档数)

POST /nba/_search{"query": {"term": {"teamNameEn": {"value": "Rockets"}}}, "aggs": {"aggsAge": {"terms": {"field": "age", "size": 10, "order": {"_count": "desc"}}}}, "size": 0
}

• 每⽀球队按该队所有球员的平均年龄进⾏分组排序 (通过分组指标值)

POST /nba/_search{"aggs": {"aggsTeamName": {"terms": {"field": "teamNameEn", "size": 30, "order": {"avgAge": "desc"}}, "aggs": {"avgAge": {"avg": {"field": "age"}}}}}, "size": 0
}

• 筛选分组聚合
  • 湖⼈和⽕箭队按球队平均年龄进⾏分组排序 (指定值列表)

POST /nba/_search{"aggs": {"aggsTeamName": {"terms": {"field": "teamNameEn", "include": ["Lakers", "Rockets", "Warriors"], "exclude": ["Warriors"], "size": 30, "order": {"avgAge": "desc"}}, "aggs": {"avgAge": {"avg": {"field": "age"}}}}}, "size": 0
}

• 湖⼈和⽕箭队按球队平均年龄进⾏分组排序 (正则表达式匹配值)

POST /nba/_search{"aggs": {"aggsTeamName": {"terms": {"field": "teamNameEn", "include": "Lakers|Ro.*|Warriors.*", "exclude": "Warriors", "size": 30, "order": {"avgAge": "desc"}}, "aggs": {"avgAge": {"avg": {"field": "age"}}}}}, "size": 0
}

• Range Aggregation 范围分组聚合
  • NBA球员年龄按20,20-35,35这样分组

POST /nba/_search{"aggs": {"ageRange": {"range": {"field": "age", "ranges": [{"to": 20}, {"from": 20, "to": 35}, {"from": 35}]}}}, "size": 0
}


• NBA球员年龄按20,20-35,35这样分组 (起别名)

POST /nba/_search{"aggs": {"ageRange": {"range": {"field": "age", "ranges": [{"to": 20, "key": "A"}, {"from": 20, "to": 35, "key": "B"}, {"from": 35, "key": "C"}]}}}, "size": 0
}

• Date Range Aggregation 时间范围分组聚合
  • NBA球员按出⽣年⽉分组

POST /nba/_search{"aggs": {"birthDayRange": {"date_range": {"field": "birthDay", "format": "MM-yyy", "ranges": [{"to": "01-1989"}, {"from": "01-1989", "to": "01-1999"}, {"from": "01-1999", "to": "01-2009"}, {"from": "01-2009"}]}}}, "size": 0
}

• Date Histogram Aggregation 时间柱状图聚合
  • 按天、⽉、年等进⾏聚合统计。可按 year (1y), quarter (1q), month (1M), week (1w), day (1d), hour (1h), minute (1m), second (1s) 间隔聚合
  • NBA球员按出⽣年分组

POST /nba/_search{"aggs": {"birthday_aggs": {"date_histogram": {"field": "birthDay", "format": "yyyy", "interval": "year"}}}, "size": 0
}


7.es之query_string查询

• 介绍&＃xff1a;query_string 查询&＃xff0c;如果熟悉lucene的查询语法&＃xff0c;我们可以直接⽤lucene查询语法写⼀个查 询串进⾏查询&＃xff0c;ES中接到请求后&＃xff0c;通过查询解析器,解析查询串⽣成对应的查询。
• 指定单个字段查询

POST /nba/_search{"query": {"query_string": {"default_field": "displayNameEn", "query": "james OR curry"}}, "size": 100
}

• 指定多个字段查询

POST /nba/_search{"query": {"query_string": {"fields": ["displayNameEn", "teamNameEn"], "query": "James AND Rockets"}}, "size": 100
}