Python Freelancers

My pubsub pull subscription is sending over the message and a None value for each message. I need t… Read more How To Filter None Values Out Of Pcollection

When I run Beam program i'm getting below error. 2021-05-20T17:04:42.166994441ZError message … Read more Attributeerror: '_dofnparam' Object Has No Attribute 'start' [while Running 'write To Gcs-ptransform-146']

I have a simple Google DataFlow task. It reads from a BigQuery table and writes into another, just … Read more Bigquery Dataflow Error: Cannot Read And Write In Different Locations While Reading And Writing In Eu

Can someone clarify what's the purpose for id_label argument in ReafFromPubSub transform? I'… Read more Beam / Dataflow ::readfrompubsub(id_label) :: Unexpected Behavior

I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)

Running a DataFlow streaming job using 2.11.0 release. I get the following authentication error af… Read more Google Cloud Dataflow Job Throws Alert After Few Hours

I am currently trying to delete all the files that are 0 Bytes within a Google Cloud Storage bucket… Read more Filter Through Files In Gcs Bucket Folder And Delete 0 Byte Files With Dataflow

I've developed an apache beam pipeline locally where I run predictions on a sample file. Locall… Read more How To Load My Pickeled Ml Model From Gcs To Dataflow/apache Beam