Teknologji Informacioni (IT)Prishtinë3 ditë më parëFull Time
General responsibilities:
Responsible to adapt business requirements into the operative system, help to improve and address the existing local business needs and other group solutions, investigate, and implement other functionalities and extensions as required.
Data Quality Analysis / Engineering and Testing / Quality Assurance.
Build, design and automate data pipelines.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Analyze business requirements, change requests, business processes, support the business lines in the definition of new IT requirements, and change request analysis within strategic projects to existing IT systems.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Databricks and Python programming language.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Support the members of the team with development, guidance and other requests.
Functional Responsibilities:
Leads new technical demands and sub-projects and drive the topic from initial request until successful rollout.
Design, Develop and Automating ETL processes/pipelines.
Ensures architecture that is in place supports the requirements of the business.
Assembles large, complex data sets that meet functional / non-functional business requirements.
Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS, and Apache Spark technologies.
Adopting industry leading technologies to support best-in-class business capabilities for high-performance computing and data storage solutions.
Driving innovation across the firm’s corporate technology portfolio, increasing efficiencies through process automation and Agile application development, with an emphasis on user experience and shorter development cycles.
Responsible for managing, monitoring, and using data after data migration to Databricks and AWS.
Job Specifications
In-depth knowledge and understanding of data engineering/data warehouse concepts and principles.
Advanced SQL knowledge and ability to analyze complex queries required. (5+ Years)
Minimum 3 years of proven knowledge in Python, Java, Scala or any relative programming language.
Bachelor’s degree in associated discipline or equivalent experience.
Knowledge with AWS cloud services or relevant cloud provider
Knowledge with Spark
Very good knowledge and understanding of system components such as RDBMS, operating system, hardware, ETL tools and processes, data modelling.
Experience with requirements analysis and generating test scenarios as a result.
Experience in large-scale environments, working with large data streams.
Resourcefulness and ability to take initiative in development and completion of software projects.
Design/model processes supporting data transformation, data structures, metadata, dependency and workload management.
Strong analytic skills related to working with unstructured datasets.
You are a team player with a hands-on approach in an agile environment.
Motivator, communicator, team player, leader, pro active, flexible and stress resistant.
Trains and mentors junior team members on areas pertaining to the role.
Fluent in both English and Albanian, spoken and written.
General responsibilities:
Responsible to adapt business requirements into the operative system, help to improve and address the existing local business needs and other group solutions, investigate, and implement other functionalities and extensions as required.
Data Quality Analysis / Engineering and Testing / Quality Assurance.
Build, design and automate data pipelines.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Analyze business requirements, change requests, business processes, support the business lines in the definition of new IT requirements, and change request analysis within strategic projects to existing IT systems.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Databricks and Python programming language.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Support the members of the team with development, guidance and other requests.
Functional Responsibilities:
Leads new technical demands and sub-projects and drive the topic from initial request until successful rollout.
Design, Develop and Automating ETL processes/pipelines.
Ensures architecture that is in place supports the requirements of the business.
Assembles large, complex data sets that meet functional / non-functional business requirements.
Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS, and Apache Spark technologies.
Adopting industry leading technologies to support best-in-class business capabilities for high-performance computing and data storage solutions.
Driving innovation across the firm’s corporate technology portfolio, increasing efficiencies through process automation and Agile application development, with an emphasis on user experience and shorter development cycles.
Responsible for managing, monitoring, and using data after data migration to Databricks and AWS.
Job Specifications
In-depth knowledge and understanding of data engineering/data warehouse concepts and principles.
Advanced SQL knowledge and ability to analyze complex queries required. (5+ Years)
Minimum 3 years of proven knowledge in Python, Java, Scala or any relative programming language.
Bachelor’s degree in associated discipline or equivalent experience.
Knowledge with AWS cloud services or relevant cloud provider
Knowledge with Spark
Very good knowledge and understanding of system components such as RDBMS, operating system, hardware, ETL tools and processes, data modelling.
Experience with requirements analysis and generating test scenarios as a result.
Experience in large-scale environments, working with large data streams.
Resourcefulness and ability to take initiative in development and completion of software projects.
Design/model processes supporting data transformation, data structures, metadata, dependency and workload management.
Strong analytic skills related to working with unstructured datasets.
You are a team player with a hands-on approach in an agile environment.
Motivator, communicator, team player, leader, pro active, flexible and stress resistant.
Trains and mentors junior team members on areas pertaining to the role.
Fluent in both English and Albanian, spoken and written.