Design, develop and maintain optimal data pipeline architecture to support data sets.
Accumulate large, complex structured and unstructured data sets that meet business requirements.
Build, prepare requirement documents.
Design, develop and implement process improvements, automating manual processes, optimizing real time data delivery.
Design and build the infrastructure required for optimal data extraction, transformation, and loading of data from a wide variety of data sources using ‘big data’ technologies.
Build analytics models and tools that utilize the data pipeline to provide actionable insights on operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Software Engineering teams internally and also with the customers to assist with data-related technical issues and support their data requirements.
Build complex automated data pipelines for creating datasets, facilitate efficient data management.
Should have discipline in writing clean and tested codes.
Requirements
Good working SQL knowledge and experience working with relational databases, as well as working familiarity with a variety of databases and data sets/feeds.
Experience building and optimizing data pipelines & architectures using data warehouse /data lake technologies.
Extensive exposure working with data modeling technologies.
5+ years of experience as a Data Engineer.
Strong analytical skills of manipulating, processing, and extracting value from large structured, unstructured datasets/feeds.
Excellent verbal and written communication skills for effective communication in a multicultural environment with teams spread throughout the world.
Strong working experience with big data technologies and tools such as Hadoop, data lake, Spark, etc..
Strong working experience in languages such as Java, Python, R, etc…
ServiceNow
Skillsets
Bachelors degree in Engineering, Computer Science, or related field.
3+ years experience with ServiceNow, developing core ITSM modules including Incident, Problem, Change, CMDB, Asset, Notify, Asset Management, Service Portal, and Agent Workspace.
Expertise with workflows, flow designer, catalog items, Business Rules, Inbound email actions, and the script includes.
Experience with web service integrations (REST, SOAP), Mid Server configuration
Experience with portal development, including the creation of custom web components in Service Portal(CSS, Angular JS, node.JS, Bootstrap).
Ability to understand product/customer needs and convert them into experiences within Agent Workspace, leveraging the full suite of workspace capabilities.
Lead role in at least one platform upgrade; familiar with upgrade process [technical and functional], risks & mitigation methods, day-of upgrade execution.
Responsibilities
Have a strong understanding of software development and business process engineering in the ServiceNow
Serve as a key technical resource regarding the configuration, development, support, and maintenance of the ServiceNow implementation and have proficiency in ServiceNow design.
Development principles that enable them to team up with external development partners and key team members to develop enterprise business solutions for our customers that use ITIL processes and best practices.
Have strong project, product management, and business management experience.
Elastic Engineer
Roles & Responsibilities
Develop and maintain log colJection capabilities using Elastic and related components
Support the development of API call playbooks used to automate man maintenance, and upgrade, of Elastic deployments
Support the development of API call playbooks used to automate customer onboarding activities and service changes
Support SOC team utilisation of Elastic deployments by functioning as a Subject Matter Expert (SME)
Perform scheduled maintenance and upgrades on Elastic Cloud deployments, and related components
Respond to alerts regarding Elastic deployment health or performance related problems
Respond to alerts regarding Elastic data and log ingestion failures and errors
Experience
Deploying and managing Elastic Cloud AWS, GCP or Azure based Elastic deployments
Deploying and managing Elastic Cloud Enterprise based Elastic clusters
Developing log and data collection capabilities using filebeat inputs and modules
Developing log and data collection capabilities using filebeat inputs and modules
Developing Elastic search ingest pipelines
Elastic Endpoint Security or Endga me agent-based security capabilities
Must Have
Operational responsibility for Elastic clusters, including deployment, configuration patching, tuning and major updates
Creation and update of custom index templates
Tuning and management of indices and Index Lifecycle Management (ILM) using X-Pack features, or external tools such as Curator or similar
