What are the Slack Archives?

It’s a history of our time together in the Slack Community! There’s a ton of knowledge in here, so feel free to search through the archives for a possible answer to your question.

Because this space is not active, you won’t be able to create a new post or comment here. If you have a question or want to start a discussion about something, head over to our categories and pick one to post in! You can always refer back to a post from Slack Archives if needed; just copy the link to use it as a reference..

Hi, I have a question about pub/sync for search. In the `spy_category_node_page_search` table there

UKEP86J66
UKEP86J66 Posts: 208 🧑🏻‍🚀 - Cadet
in Help

Hi, I have a question about pub/sync for search. In the spy_category_node_page_search table there is a data column and a structured_data column.
I assume the data column is used to populate ElasticSearch but I am not clear what the other field is for. Reason to ask is on our project the structured_data field is becoming very large and affecting performance.
I guess the short question is can we just stop populating that field 🙂

Comments

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet
    edited January 2020

    You can't drop it, because:
    1. Different plugins are executed on this data to have all data in document
    2. You can only if you run all plugins all the time, which will then result in slow P&S
    3. It's spryker - bad by design in default...

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    @UNBSW8S8K can you please elaborate what you mean with bad design in general?

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet

    Storing data, aggregating data, (facets, terms), php code is just crap (it's pure nightmare to work on it)

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet

    And there are many many bugs...

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    Why is the code crap?

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet

    Really? You are asking this? Just look at it...

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    What concrete bugs you are referring to?

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet
    edited January 2020

    You can't unit test that shit.

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    Why can't you test it?

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    What is unit test?

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet
    edited January 2020

    Me & my colleagues have reported all, some are not fixed since July (last year).

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    What reported all means?

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet

    Keep going... troll

  • UKHD8KTMF
    UKHD8KTMF Posts: 393 🧑🏻‍🚀 - Cadet

    What is this trolling?

  • giovanni.piemontese
    giovanni.piemontese Technical Lead @ Löffelhardt Spryker Solution Partner Posts: 871 🧑🏻‍🚀 - Cadet

    @UNBSW8S8K maybe there are no major or blocker tickets? Where were been reported????

    Are u right to say code crap? what is code crap? etc.... @UKHD8KTMF all questions please reply...

  • UKEP86J66
    UKEP86J66 Posts: 208 🧑🏻‍🚀 - Cadet

    I've not looked at the code but I've been told on another channel the structured_data field in the db is for debug purposes only.

  • UNBSW8S8K
    UNBSW8S8K Posts: 128 🧑🏻‍🚀 - Cadet
    edited January 2020

    No, it is not. It is used in scenarios, when e.g. event is updating part of document only. In that case data changed by this event is merged together with structured data & full document is generated.

  • UKEP86J66
    UKEP86J66 Posts: 208 🧑🏻‍🚀 - Cadet

    Thanks you are right 🙂

  • LilyAcrossDimensions
    LilyAcrossDimensions Inclusive Culture & Belonging Partner Sprykee Posts: 18 🏛 - Council (mod)

    dear @UNBSW8S8K if you are based in Berlin, it would be great if you could also accompany your colleagues when they come to our office next time again. We would like to learn from your experience in person and together find ways to improve your experience with the Spryker code.

Categories