GCP python Data Engineer @GcpPython

BI developer moved from MSC to GCP world and tasked with building a data infrastructure from scratch. Learn python and use it to build data pipelines. ForReal UK Joined September 2019

Tweets

17
Followers

55
Following

47
Likes

16

Markus Schirp @_m_b_j_

5 years ago

I'm 10y remote now and 99% of all interactions with my heavy remote / async teams are NOT done with calls / video. It almost all in writing. Everyone right now trying to optimize for voice / video communication is optimizing into the wrong thing.

77 1K 5K 0 223

GCP python Data Engineer @GcpPython

6 years ago

I am preparing to plan and deploy a Cloud Composer in #GCP any tips for compulsory material to research, things to look out for, etc ? @GCPcloud

0 0 1 0 0

GCP python Data Engineer @GcpPython

6 years ago

A very interesting article on #GCP #GoogleCloud providing a look behind the scenes of decision making. Read in full and don't assume content bu its tile. theinformation.com/articles/googl…

0 0 1 0 0

GCP python Data Engineer @GcpPython

6 years ago

"Confidential material: This page is confidential. Do not share or discuss until authorized to do so. " I feel like James Bond 😎

0 0 1 0 0

Download Image

GCP python Data Engineer @GcpPython

6 years ago

#GoogleNext19 London tomorrow 🥳

0 0 1 0 0

GCP python Data Engineer @GcpPython

6 years ago

I just can't get #Dataflow JDBC template to work with SQL server. I have a sqlserver box hosted on #GCP and want to get the data out of it into #bigquery. Any magical syntax you know of or blog/article for this exact case? I will re-post if I find a solution

0 0 1 0 0

GCP python Data Engineer @GcpPython

6 years ago

Really enjoying reading this #bigquery book! I wish I had it a year ago as it would have saved me sooo much time and struggle. At least now I can appreciate much more

0 0 4 0 1

Download Image

GCP python Data Engineer @GcpPython

6 years ago

Transferring Big Query, intercontinental data sets into a new project and re pointing #GoogleAnalytics sure does have a few gotchas. Main one is the project quota on jobs and removing redundant tables views, one by one. BigQ API + #python to the rescue 😃

0 0 1 0 0

GCP python Data Engineer @GcpPython

6 years ago

Fantastic decision Jesse! I wish more people did that. Thank you for sharing your knowledge and being an example to others

0 0 0 0 0

Download Gif

GCP python Data Engineer @GcpPython

6 years ago

My first #AppacheNiFi data pipeline. Extract JSON files from S3 bucket and load to GCS and local disk. Pretty pleased by it. I am Impressed by speed and looking forward to now exploring the support for python. Not yet hosted in gcp..

0 1 0 0 0

Download Image

GCP python Data Engineer @GcpPython

6 years ago

Looking for GUI pipeline builders (business req). Current contender: Apache Nifi. Got a pipeline built to fetch S3 files and store in GCS. Now just figure out the best way to Set NiFi in GCP

0 0 0 0 0

GCP python Data Engineer @GcpPython

6 years ago

I have been struggling to get the Data Fusion to work with S3. If I go through wrangler, I can connect to the S3 bucket. When then moving into studio, no joy. It complains about not seeing the file system. There goes the 'easy drag and drop' #hybridcloud #GCP #DataFusion #AWS