![]() ![]() 13:44:42 [43mdestination[0m > 13:44:42 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):132 - Preparing tables in destination completed. ![]() schema: public, tmp table name: _airbyte_tmp_gth_django_celery_beat_periodictask 13:44:42 [43mdestination[0m > 13:44:42 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream django_celery_beat_periodictask. schema: public, tmp table name: _airbyte_tmp_pdu_django_celery_beat_intervalschedule 13:44:42 [43mdestination[0m > 13:44:42 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream django_celery_beat_intervalschedule. 13:44:42 [44msource[0m > 13:44:42 [32mINFO[m i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):268 - Searching for WAL resume position 13:44:42 [44msource[0m > 13:44:42 [32mINFO[m i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.django_celery_beat_clockedschedule' is 'DEFAULT' UPDATE and DELETE events will contain previous values only for PK columns ![]() 13:44:42 [44msource[0m > 13:44:42 [32mINFO[m i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.django_celery_beat_intervalschedule' is 'DEFAULT' UPDATE and DELETE events will contain previous values only for PK columns 13:44:42 [44msource[0m > 13:44:42 [32mINFO[m i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.django_celery_beat_crontabschedule' is 'DEFAULT' UPDATE and DELETE events will contain previous values only for PK columns 13:44:42 [44msource[0m > 13:44:42 [32mINFO[m i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.django_celery_beat_periodictask' is 'DEFAULT' UPDATE and DELETE events will contain previous values only for PK columns schema: public, tmp table name: _airbyte_tmp_khf_django_celery_beat_crontabschedule 13:44:42 [43mdestination[0m > 13:44:42 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream django_celery_beat_crontabschedule. On the source postgres db I set the max_wal_workers to 1 because there is only one replication slot, increasing this value just causes a different connection error saying the replication slot is already in use. This is all on a M1 mac so i had to build everything from latest to run native arm. Seems like a race condition, maybe due to both db instances on localhost w/ different ports ? It is not an intermittent problem. The initial load works great, but every subsequent sync fails where it trying to make a second jdbc connection back to the source db. For a POC i built a postgres to postgres connection for 5 tables local, docker deployment, basic normalization and incremental with dedup history replication. I am evaluating using airbyte for a new DW. Destination name/version: Postgres - latest.Is this your first time deploying Airbyte?: Yes.I haven’t found any love from Google searching this specific log message. GitHub (based on the comment in the Dockerfile that the M1 chip was particularly finicky).Snowflake-Labs/sfguide-citibike-ml-snowpark-python.I’ve also tried using a different base image: sfguide-citibike-ml-snowpark-python/Dockerfile at main I’ve increased the cores, memory, and swap memory for Docker Desktop. The log messages for each are: PR_SET_CHILD_SUBREAPER is unavailable on this platform. When I look at the containers, all but the postgres server are continually restarting 49752fd4f1de dbt-airflow-example_e912b5/airflow:latest "/entrypoint bash -c…" 8 hours ago Restarting (1) 57 seconds ago dbt-airflow-example_e912b5-webserver-1Ĩa3bdf7ed28f dbt-airflow-example_e912b5/airflow:latest "/entrypoint bash -c…" 8 hours ago Restarting (1) 57 seconds ago dbt-airflow-example_e912b5-scheduler-1ģac5f447eefe dbt-airflow-example_e912b5/airflow:latest "/entrypoint bash -c…" 8 hours ago Restarting (1) 57 seconds ago dbt-airflow-example_e912b5-triggerer-1Ĭ3d67cd97d3a postgres:12.6 "docker-entrypoint.s…" 8 hours ago Up 9 minutes 0.0.0.0:5432->5432/tcp dbt-airflow-example_e912b5-postgres-1 I’m trying to run astrocli on my Macbook (Apple M1 chip)Īirflow is starting up! This might take a few minutes… ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |