What are the Slack Archives?
Itβs a history of our time together in the Slack Community! Thereβs a ton of knowledge in here, so feel free to search through the archives for a possible answer to your question.
Because this space is not active, you wonβt be able to create a new post or comment here. If you have a question or want to start a discussion about something, head over to our categories and pick one to post in! You can always refer back to a post from Slack Archives if needed; just copy the link to use it as a reference..
I have a P&S issue. The product data in ElasticSearch is out of sync with the database. Iβm tryi
Comments
-
@UK9N7MP96 I will try to get the propel log/reproduce it on local but it will take some time.
0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadetwhich version of product-page-search do u have?
this version https://github.com/spryker/product-page-search/releases/tag/3.9.0. fix some memory problem (come from 2 week ago)
0 -
@UL65CH0MC that fixed the publishing memory issue, but it looks @UNTTWV4JK has memory issue on synchronization part
0 -
@UK9N7MP96 this is the full error ```
Fatal error: Allowed memory size of 2147483648 bytes exhausted (tried to allocate 12288 bytes) in /data/vendor/propel/propel/src/Propel/Runtime/Connection/StatementWrapper.php on line 238
ErrorException - Exception: FATAL ERROR - Allowed memory size of 2147483648 bytes exhausted (tried to allocate 12288 bytes)
in /data/vendor/propel/propel/src/Propel/Runtime/Connection/StatementWrapper.php (238)Command: vendor/bin/console sync:data product_abstract 26940
Trace:
0 /data/vendor/spryker/error-handler/src/Spryker/Shared/ErrorHandler/ErrorHandlerEnvironment.php(99): Spryker\Shared\ErrorHandler\ErrorHandler->handleFatal()
1 [internal function]: Spryker\Shared\ErrorHandler\ErrorHandlerEnvironment->Spryker\Shared\ErrorHandler{closure}()
```
0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadet
@UK9N7MP96 u are right...
0 -
@UNTTWV4JK this line is not in the full stack
0 -
however that doesnβt tell too much
0 -
AFAIK the P&S is building pairs between the storage entries and the entities to determine what need to be saved. 38 entries from the spy_product_abstract_page_search paired with the entities⦠this will use a lot of memory before starting to save the data in elastic
0 -
True, but this is happening in publishing part when you run
queue:worker:startorqueue:task:start event0 -
sync:datais responsible to query theproduct_abstract_page_searchorproduct_abstract_storageto just return the value ofdatacolumn and write them in to the queue0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadet
I have 2,5Mio Products with 7000Attributes and other stuff and just test on my system the console command synch product abstract and it seems that everything works fine.. .BUT: i have only 1Store, 1Language, 1Currency now..
0 -
we have more
0 -
20 stores, 8 locales, 8 currencies, 2 price typesβ¦
0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadet
and only 38 products? right?
0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadet
or only 38 are published and u have more?
0 -
no, these are the search entries for one product
0 -
is combination of stores/locale
0 -
for one product
0 -
giovanni.piemontese Technical Lead @ LΓΆffelhardt Spryker Solution Partner Posts: 871 π§π»βπ - Cadet
ok understood... yes i know your environment..
I noted on my system that i give as u only 1 id to be published but i see that the command just fetch all products... can u please check if before the memory fatal error u see some events on rmq under sync.search.product?
0 -
@UNTTWV4JK which version of
spryker/product-page-searchare you using?0 -
I found a bug for
sync:datafor specificidshereSpryker/Zed/Synchronization/Business/Export/ExporterPluginResolver.php:72$idsis missing0 -
will report it now
0 -
@UNTTWV4JK can you reduce the chunk size?
0 -
you can do it by adding this line into your
config_default-production.php$config[\Spryker\Shared\Synchronization\SynchronizationConstants::EXPORT_MESSAGE_CHUNK_SIZE] = 50;0 -
this is the query which works with chunking and avoid any memory issue, if you still get memory issue you can reduce the chunk size
0 -
\Spryker\Zed\Synchronization\Business\Iterator\SynchronizationDataQueryContainerPluginIterator0 -
Thanks for suggestions, I will try tomorrow.
0 -
FYI: The memory issue is gone after adding the $ids in the method.
0 -
Yes that will be fixed in new release for that module, but without
idyou should not see any memory issue as well0
Categories
- All Categories
- 42 Getting Started & Guidelines
- 7 Getting Started in the Community
- 8 Additional Resources
- 7 Community Ideas and Feedback
- 84 Spryker News
- 977 Developer Corner
- 828 Spryker Development
- 91 Spryker Dev Environment
- 362 Spryker Releases
- 3 Oryx frontend framework
- 36 Propel ORM
- 68 Community Projects
- 3 Community Ideation Board
- 30 Hackathon
- 3 PHP Bridge
- 6 Gacela Project
- 32 Job Opportunities
- 3.2K π Slack Archives
- 116 Academy
- 5 Business Users
- 370 Docker
- 551 Slack General
- 2K Help
- 75 Knowledge Sharing
- 6 Random Stuff
- 4 Code Testing
- 33 Product & Business Questions
- 70 Spryker Safari Questions
- 50 Random