Hi I am Carl Davidson,I am 32 year old data engineer. I currently work for Nationwide building society. I have recently moved into a new role within the society, Working within SSIS, for data loading. In the past within the society I was working on regulatory based work. My key responsibilities is to help develop changes based on business and member needs.
Within my personal time I like to build websites, using a range of technologies. Incorporating CICD into my projects for simple and easy releasing to my web servers. This is done via GitHub and Jenkins.
When building websites I have 1 of 2 routes I will usually take. If I am building with a friend I will take over the server setup, PHP and SQL parts of the build, and They would normally develop using angular. When I'm building the site by myself I opt to use a Materialize framework for the front end design.
I have been working within data for the last 6 years. Within this time a have worked a range of roles with a range of different data types.
I started my data journey working within the microsoft tech stack, This involved working with MS SQL Server 2012 and SSIS. During my time working in these environments I was supporting data migrations. We were trying to migrate the data from 4 separate code bases into one. Using SSIS as the mapping tool testing the move of data to support the one code base project.
After the completion of the one code base Project. I moved onto building schema for supporting the move of data from one Database eco system to another, while supporting transformations. We were moving data from an oracle system into a Microsoft SQL instance to finish of in Salesforce, the aim of the SQL system was to do the heaving lifting of batch processing before promoting the data up to the Salesforce system
Following on from this work I moved more towards Azure. During this time I was supporting the running of pipelines for auto deployment of code to databases. Along with managing and maintaining the Git repo for the environmental variables for many SSIS projects held within SQL Server
More recently I have been reviewing business logic within stored procedures for regulatory reporting, and makinging changes based on business requirements. These chunks of code are large and complex, completing small tasks to merge into the final output that is required. Part of this work included finding ways to add efficiency to the code so that I can run in the shortest time possible.
At the moment I’m working within a scrum team, developing SSIS packages for the consumption of file data and merging data from with a DBO connection.Along sided this i have been supporting new team members with coding within sql and building SSIS packages