-
Notifications
You must be signed in to change notification settings - Fork 8
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
Elasticsearch is silently dropping ingested metadata when there is a data type conflict in properties.attributes field. Columbus returns 200 but the metadata is not ingested.
To Reproduce
Steps to reproduce the behavior:
- Create a new type/index called
dashboard - Ingest a new data to the
dashboardindex withproperties.attributes.idfield is in integer e.g.1234 - Check and verify elasticsearch, the data supposed to be ingested properly
- Ingest another new data to the
dashboardindex withproperties.attributes.idfield is in string e.g."df431-54abf42-xxxx" - Check and verify elasticsearch, the other new data is not ingested
Expected behavior
Ingesting different kind of metadata that has the same type should always be succeed.
Additional context
This is happened when we tried to ingest metabase and tableau dashboard data. We ingest metabase metadata first, then tableau data. tableau data is not ingested to elasticsearch because it has id in string and metabase has id in long.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working