aggregation framework - MongoDB Aggregate Slow Performance When Using Sort -

-

i have collection (tvshow episodes) more 1,200,000 document,

here schema :

  var episodeschema = new schema({     imdbid: { type : string },     showid: {type : string},     episodeid: { type : string },     episodeidnumber:{ type : number },     episodetitle:{ type : string },     showtitle:{type : string},     seasonnumber:{type : number},     episodenumber:{type : number},     airdate : {type : string},     summary:{type : string} });

i created index episodetitle episodeidnumber seasonnumber episodenumber episodeid , showid

now used mongodb aggregate group every tvshow episodes

here aggregate query used :

episode.aggregate( [             { $match : { showid : "scorpion" } },             {$sort:{"episodenumber":-1}},             { $group: {              _id: "$seasonnumber", count: { $sum: 1 } ,             episodes : { $push:  { episodeid : "$episodeid" , episodetitle: "$episodetitle" , episodenumber: "$episodenumber" , seasonnumber: "$seasonnumber" , airdate: "$airdate"  } }              } }             ,             { $sort : { _id : -1  } } ] )

now when run query take more 2605.907 ms , after digging found out why slow , because of using {$sort:{"episodenumber":-1}} , without using {$sort:{"episodenumber":-1}} take around 19.178 ms run.

as mentioned above create index episodenumber field , based on mongodb aggregation pipeline optimization used sort after match ok , , didn't wrong.

so after thought wrong indexes , removed episodenumber index , reindexd , had same time nothing changed.

at end 1 time tried run aggregate group query without episodenumber indexed , surprisingly faster ! take around 20.118 ms .

i wants know why happened , isn't indexes faster query ?

update

query explain output :

{         "waitedms" : numberlong(0),         "stages" : [             {                 "$cursor" : {                     "query" : {                         "showid" : "scorpion"                     },                     "sort" : {                         "episodenumber" : -1                     },                     "fields" : {                         "airdate" : 1,                         "episodeid" : 1,                         "episodenumber" : 1,                         "episodetitle" : 1,                         "seasonnumber" : 1,                         "_id" : 0                     },                     "queryplanner" : {                         "plannerversion" : 1,                         "namespace" : "test.episodes",                         "indexfilterset" : false,                         "parsedquery" : {                             "showid" : {                                 "$eq" : "scorpion"                             }                         },                         "winningplan" : {                             "stage" : "eof"                         },                         "rejectedplans" : [ ]                     }                 }             },             {                 "$group" : {                     "_id" : "$seasonnumber",                     "count" : {                         "$sum" : {                             "$const" : 1                         }                     },                     "episodes" : {                         "$push" : {                             "episodeid" : "$episodeid",                             "episodetitle" : "$episodetitle",                             "episodenumber" : "$episodenumber",                             "seasonnumber" : "$seasonnumber",                             "airdate" : "$airdate"                         }                     }                 }             },             {                 "$sort" : {                     "sortkey" : {                         "_id" : -1                     }                 }             }         ],         "ok" : 1     }


Comments

Post a Comment

Popular posts from this blog

ios - RestKit 0.20 — CoreData: error: Failed to call designated initializer on NSManagedObject class (again) -

-
this error has shown on many times, seems. prominent answer issue seems restkit 0.20 — coredata: error: failed call designated initializer on nsmanagedobject class however, solution posted doesn't work me. let's start beginning: i want upload file server. want parse response make sure uploaded. if not, try again later. model has boolean variable called nsnumber *senttoserver purpose (in coredata, bool saved nsnumber ) . because don't know whether sending going successful, save entity coredata model first before sending via restkit. when post request successful, server returns json string this: {"id":14,"created":true} notice that, of course, id not set on coredata model yet, both id , created new informations model. here's model: @interface recording : nsmanagedobject @property (nonatomic, retain) nsstring * audiofilepath; @property (nonatomic, retain) nsdate * createdat; @property (nonatomic, retain) nsstring * deviceid; @...
Read more

java - Digest auth with Spring Security using javaconfig -

-
so i'm trying create digest authentication spring following documentation trying translate xml "requirements" in java requirements. let's have xml in docs: <bean id="digestfilter" class= "org.springframework.security.web.authentication.www.digestauthenticationfilter"> <property name="userdetailsservice" ref="jdbcdaoimpl"/> <property name="authenticationentrypoint" ref="digestentrypoint"/> <property name="usercache" ref="usercache"/> </bean> <bean id="digestentrypoint" class= "org.springframework.security.web.authentication.www.digestauthenticationentrypoint"> <property name="realmname" value="contacts realm via digest authentication"/> <property name="key" value="acegi"/> <property name="noncevalidityseconds" value="10"/> </b...
Read more

laravel - PDOException in Connector.php line 55: SQLSTATE[HY000] [1045] Access denied for user 'root'@'localhost' (using password: YES) -

-
my .env: app_env=local app_debug=true app_key=myappkey app_url=http://localhost db_connection=mysql db_host=localhost db_port=3306 db_database=gestiontaller db_username=root db_password='root' cache_driver=file session_driver=file queue_driver=sync redis_host=127.0.0.1 redis_password=null redis_port=6379 mail_driver=smtp mail_host=mailtrap.io mail_port=2525 mail_username=null mail_password=null mail_encryption=null i've tried password ", ' , without, restarting server every time. i've tried changing localhost 172.0.0.1. yes, password correct, running mysql -u root -p introducing password root in prompt can go mysql. users table: +------------------+-----------+ | user | host | +------------------+-----------+ | debian-sys-maint | localhost | | mysql.sys | localhost | | root | localhost | | root1 | localhost | +------------------+-----------+ i've added homestead.yaml this: database_port: 3306 ...
Read more