Laravel Scout Elasticsearch Driver

This package offers advanced functionality for searching and filtering data in Elasticsearch. Check out its features!

Contents

• Tutorial
• Features
• Requirements
• Installation
• Configuration
• Index configurator
• Searchable model
• Usage
• Console commands
• Search rules
• Available filters
• Debug

Features

• An easy way to configure and create an Elasticsearch index.
• A fully configurable mapping for each model.
• A possibility to add a new field to an existing mapping automatically or using the artisan command.
• Lots of different ways to implement your search algorithm: using search rules or a raw search.
• Various filter types to make a search query more specific.

Requirements

The package has been tested in the following configuration:

• PHP version >= 7.0
• Laravel Framework version >= 5.5
• Elasticsearch version >= 5.5

Installation

Use composer to install the package:

composer require synergy/scout-elasticsearch-driver

Configuration

To configure the package you need to publish settings first:

php artisan vendor:publish --provider="Laravel\Scout\ScoutServiceProvider"
php artisan vendor:publish --provider="SynergyScoutElastic\providers\SynergyScoutElasticServiceProvider"

Then, set the driver setting to elastic in the config/scout.php file and configure the driver itself in the config/synergy-scout-elastic.php file. There are two available options:

Option	Description
client	A setting hash to build Elasticsearch client. More information you can find here. By default the host is set to localhost:9200.
update_mapping	The option that specifies whether to update a mapping automatically or not. By default it is set to true.

Index configurator

An index configurator class is used to set up settings for an Elasticsearch index. To create a new index configurator use the following artisan command:

php artisan make:index-configurator MyIndexConfigurator

It'll create the file MyIndexConfigurator.php in the app folder of your project. You can specify index name, settings and default mapping like in the following example:

<?php

namespace App;

use SynergyScoutElastic\IndexConfigurator;

class MyIndexConfigurator extends IndexConfigurator
{
    // It's not obligatory to determine name. By default it'll be a snaked class name without `IndexConfigurator` part.
    protected $name = 'my_index';  
    
    // You can specify any settings you want, for example, analyzers. 
    protected $settings = [
        'analysis' => [
            'analyzer' => [
                'es_std' => [
                    'type' => 'standard',
                    'stopwords' => '_spanish_'
                ]
            ]    
        ]
    ];

    // Common mapping for all types.
    protected $defaultMapping = [
        '_all' => [
            'enabled' => true
        ],
        'dynamic_templates' => [
            [
                'es' => [
                    'match' => '*_es',
                    'match_mapping_type' => 'string',
                    'mapping' => [
                        'type' => 'string',
                        'analyzer' => 'es_std'
                    ]
                ]    
            ]
        ]
    ];
}

More about index settings and default mapping you can find in the index management section of Elasticsearch documentation.

To create an index just run the artisan command:

php artisan elastic:create-index App\\MyIndexConfigurator

Searchable model

To create a model with the ability to perform search requests in an Elasticsearch index use the command:

php artisan make:searchable-model MyModel --index-configurator=MyIndexConfigurator

After executing the command you'll find the file MyModel.php in you app folder:

<?php

namespace App;

use SynergyScoutElastic\Models\Searchable;
use Illuminate\Database\Eloquent\Model;
use SynergyScoutElastic\Models\SearchableInterface;

class MyModel extends Model implements SearchableInterface
{
    use Searchable;

    protected $indexConfigurator = MyIndexConfigurator::class;

    protected $searchRules = [
        //
    ];

    // Here you can specify a mapping for a model fields.
    protected $mapping = [
        'properties' => [
            'text' => [
                'type' => 'string',
                'fields' => [
                    'raw' => [
                        'type' => 'string',
                        'index' => 'not_analyzed',
                    ]
                ]
            ],
        ]
    ];
}

Each searchable model represents an Elasticsearch type. By default a type name is the same as a table name, but you can set any type name you want through the searchableAs method. You can also specify fields which will be indexed by the driver through the toSearchableArray method. More information about these options you will find in the scout official documentation.

The last important option you can set in the MyModel class is the $searchRules property. It allows you to set different search algorithms for a model. We'll take a closer look at it in the search rules section.

After setting up a mapping in your model you can update an Elasticsearch type mapping:

php artisan elastic:update-mapping App\\MyModel

Usage

Once you've created an index configurator, an Elasticsearch index itself and a searchable model, you are ready to go. Now you can index and search data according to the documentation.

In addition to standard functionality the package offers you the possibility to filter data in Elasticsearch without specifying query string:

App\MyModel::search('*')
    ->where('id', 1)
    ->get();

Also you can override model search rules:

App\MyModel::search('Brazil')
    ->rule(App\MySearchRule::class)
    ->get();

And use variety of where conditions:

App\MyModel::search('*')
    ->whereRegexp('name.raw', 'A.+')
    ->where('age', '>=', 30)
    ->whereExists('unemployed')
    ->get();

At last, if you want to send a custom request, you can use the searchRaw method:

App\MyModel::searchRaw([
    'query' => [
        'bool' => [
            'must' => [
                'match' => [
                    '_all' => 'Brazil'
                ]
            ]
        ]
    ]
]);

This query will return raw response.

Console commands

Available artisan commands are listed below:

Command	Arguments	Description
make:index-configurator	name - The name of the class	Creates a new Elasticsearch index configurator.
make:searchable-model	name - The name of the class	Creates a new searchable model.
make:search-rule	name - The name of the class	Creates a new search rule.
elastic:create-index	index-configurator - The index configurator class	Creates an Elasticsearch index.
elastic:update-index	index-configurator - The index configurator class	Updates settings and mappings of an Elasticsearch index.
elastic:drop-index	index-configurator - The index configurator class	Drops an Elasticsearch index.
elastic:update-mapping	model - The model class	Updates a model mapping.

For detailed description and all available options run php artisan help [command] in the command line.

Search rules

A search rule is a class that describes how a search query will be executed. To create a search rule use the command:

php artisan make:search-rule MySearchRule

In the file app/MySearchRule.php you will find a class definition:

<?php

namespace App;

use SynergyScoutElastic\SearchRule;

class MySearch extends SearchRule
{
    // This method returns an array that represents a content of bool query.
    public function buildQueryPayload()
    {
        return [
            'must' => [
                'match' => [
                    'name' => $this->builder->query
                ]
            ]
        ];
    }
}

You can read more about bool queries here.

The default search rule returns the following payload:

return [
   'must' => [
       'match' => [
           '_all' => $this->builder->query
       ]
   ]
];

This means that by default when you call search method on a model it tries to find the query string in any field.

To determine default search rules for a model just add a property:

<?php

namespace App;

use SynergyScoutElastic\Models\Searchable;
use Illuminate\Database\Eloquent\Model;
use SynergyScoutElastic\Models\SearchableInterface;

class MyModel extends Model implements SearchableInterface
{
    use Searchable;
    
    // You can set several rules for one model. In this case, the first not empty result will be returned.
    protected $searchRules = [
        MySearchRule::class
    ];
}

You can also set a search rule in a query builder:

// You can set either a SearchRule class
App\MyModel::search('Brazil')
    ->rule(App\MySearchRule::class)
    ->get();
    
// or a callable
App\MyModel::search('Brazil')
    ->rule(function($builder) {
        return [
            'must' => [
                'match' => [
                    'Country' => $builder->query
                ]
            ]
        ];
    })
    ->get();

Available filters

You can use different types of filters:

Method	Example	Description
where($field, $value)	where('id', 1)	Checks equality to a simple value.
where($field, $operator, $value)	where('id', '>=', 1)	Filters records according to a given rule. Available operators are: =, <, >, <=, >=, <>.
whereIn($field, $value)	where('id', [1, 2, 3])	Checks if a value is in a set of values.
whereNotIn($field, $value)	whereNotIn('id', [1, 2, 3])	Checks if a value isn't in a set of values.
whereBetween($field, $value)	whereBetween('price', [100, 200])	Checks if a value is in a range.
whereNotBetween($field, $value)	whereNotBetween('price', [100, 200])	Checks if a value isn't in a range.
whereExists($field)	whereExists('unemployed')	Checks if a value is defined.
whereNotExists($field)	whereNotExists('unemployed')	Checks if a value isn't defined.
whereRegexp($field, $value, $flags = 'ALL')	whereRegexp('name.raw', 'A.+')	Filters records according to a given regular expression. Here you can find more about syntax.

In most cases it's better to use raw fields to filter records, i.e. not analyzed fields.

Debug

There are two methods that can help you to analyze results of a search query:

• explain

  App\MyModel::search('Brazil')
      ->first()
      ->explain();

• profile

  App\MyModel::search('Brazil')
      ->first()
      ->profile();

Both methods return raw data from ES.

Besides, you can get a query payload that will be sent to ES, by calling the buildPayload method.

App\MyModel::search('Brazil')
    ->buildPayload();

Note, that this method returns a collection of payloads, because of possibility of using multiple search rules in one query.