Job description As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong MS SQL, Azure Databricks experience Implement and manage data models in DBT, data transformation and alignment with business requirements. Ingest raw, unstructured data into structured datasets to cloud object store. Utilize DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting. Write and optimize SQL queries within DBT to enhance data transformation processes and improve overall performance Preferred technical and professional experience Establish best DBT processes to improve performance, scalability, and reliability. Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Databricks Proven interpersonal skills while contributing to team effort by accomplishing related results as required Role: Data Platform Engineer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills azure databricksdata managementsql serversqldata transformation pythondata analysisdata analyticsdata warehousingpower biazure data factorymachine learningbusiness intelligencetableaudata extractiondata modelingdata visualizationetl
Posted 2 hours ago
•
Typically responds within 2 days
Job description We are seeking a highly skilled Advanced Analytics Specialist to join our dynamic team. The successful candidate will be responsible for leveraging advanced analytics techniques to derive actionable insights, inform business decisions, and drive strategic initiatives. This role requires a deep understanding of data analysis, statistical modelling, machine learning, and data visualization. In this role, you will be responsible for architecting and delivering AI solutions using cutting-edge technologies, with a strong focus on foundation models and large language models. You will work closely with customers, product managers, and development teams to understand business requirements and design custom AI solutions that address complex challenges. Experience with tools like Github Copilot, Amazon Code Whisperer etc. is desirable. Success is our passion, and your accomplishments will reflect this, driving your career forward, propelling your team to success, and helping our clients to thrive. Day-to-Day Duties: Proof of Concept (POC) DevelopmentDevelop POCs to validate and showcase the feasibility and effectiveness of the proposed AI solutions. Collaborate with development teams to implement and iterate on POCs, ensuring alignment with customer requirements and expectations. Help in showcasing the ability of Gen AI code assistant to refactor/rewrite and document code from one language to another, particularly COBOL to JAVA through rapid prototypes/ PoC Documentation and Knowledge SharingDocument solution architectures, design decisions, implementation details, and lessons learned. Create technical documentation, white papers, and best practice guides. Contribute to internal knowledge sharing initiatives and mentor new team members. Industry Trends and InnovationStay up to date with the latest trends and advancements in AI, foundation models, and large language models. Evaluate emerging technologies, tools, and frameworks to assess their potential impact on solution design and implementation Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Develop and implement advanced analytical models and algorithms to solve complex business problems, analyze large datasets to uncover trends, patterns, and insights that drive business performance. Collaborate with cross-functional teams to identify key business challenges and opportunities, Create and maintain data pipelines and workflows to ensure the accuracy and integrity of data, Design and deliver insightful reports and dashboards to communicate findings to stakeholders. Stay up to date with the latest advancements in analytics, machine learning, and data science. Provide technical expertise and mentorship to junior team members. QualificationsBachelor’s or master’s degree in data science, Statistics, Mathematics, Computer Science, or a related field. Proven experience in advanced analytics, data science, or a similar role. Proficiency in programming languages such as Python, R, or SQL. Experience with data visualization tools like Tableau, Power BI, or similar. Strong understanding of statistical modelling and machine learning algorithms. Excellent analytical, problem-solving, and critical thinking skills. Ability to communicate complex analytical concepts to non-technical stakeholders. Experience with big data technologies (e.g., Hadoop, Spark) is a plus Preferred technical and professional experience Familiarity with cloud-based analytics platforms (e.g., AWS, Azure). Knowledge of natural language processing (NLP) and deep learning techniques. Experience with project management and agile methodologies Role: Data Scientist Industry Type: IT Services & Consulting Department: Data Science & Analytics Employment Type: Full Time, Permanent Role Category: Data Science & Machine Learning Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills data analysismachine learningstatistical modelingdata visualizationmachine learning algorithms a
Posted 5 hours ago
•
Typically responds within 2 days
Job description As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Must have 5+ years exp in Big Data -Hadoop Spark -Scala ,Python Hbase, Hive Good to have Aws -S3, athena ,Dynomo DB, Lambda, Jenkins GIT Developed Python and pyspark programs for data analysis. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine). Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations Preferred technical and professional experience Understanding of Devops. Experience in building scalable end-to-end data ingestion and processing solutions Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala Role: Data Platform Engineer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills scalahadoop sparksparkbig datapython hiveclouderapysparksqljavagitpostgresqldevopsjenkinsdata ingestionmysqlhadoopetlhbasedata analysisdynamo dbooziemicrosoft azureimpaladata engineeringlambda expressionskafkasqoopaws
Posted 1 day ago
•
Typically responds within 2 days
Job description As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviour’s. Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modelling results Expertise in designing and implementing scalable data warehouse solutions on Snowflake, including schema design, performance tuning, and query optimization. Strong experience in building data ingestion and transformation pipelines using Talend to process structured and unstructured data from various sources. Proficiency in integrating data from cloud platforms into Snowflake using Talend and native Snowflake capabilities. Hands-on experience with dimensional and relational data modelling techniques to support analytics and reporting requirements. Understanding of optimizing Snowflake workloads, including clustering keys, caching strategies, and query profiling. Ability to implement robust data validation, cleansing, and governance frameworks within ETL processes. Proficiency in SQL and/or Shell scripting for custom transformations and automation tasks Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Tableau Desktop Specialist, SQL -Strong understanding of SQL for Querying database Good to have - Python ; Snowflake, Statistics, ETL experience. Extensive knowledge on using creating impactful visualization using Tableau. Must have thorough understanding of SQL & advance SQL (Joining & Relationships) Preferred technical and professional experience Must have experience in working with different databases and how to blend & create relationships in Tableau. Must have extensive knowledge to creating Custom SQL to pull desired data from databases. Troubleshooting capabilities to debug Data controls. Capable of converting business requirements into workable model. Good communication skills, willingness to learn new technologies, Team Player, Self-Motivated, Positive Attitude. Role: Data Science & Analytics - Other Industry Type: IT Services & Consulting Department: Data Science & Analytics Employment Type: Full Time, Permanent Role Category: Data Science & Analytics - Other Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills advance sqlsnowflakesqlshell scriptingdatabase queries pythonperformance tuningtalenddbmscloud platformswarehousemachine learningbusiness intelligencepipelineelastic searchtableaudata ingestionsplunketlbig datastatistics
Posted 1 day ago
•
Typically responds within 2 days
Job description As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Experience with Apache Spark (PySpark)In-depth knowledge of Spark’s architecture, core APIs, and PySpark for distributed data processing. Big Data TechnologiesFamiliarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts. Strong proficiency in PythonExpertise in Python programming with a focus on data processing and manipulation. Data Processing FrameworksKnowledge of data processing libraries such as Pandas, NumPy. SQL ProficiencyExperience writing optimized SQL queries for large-scale data analysis and transformation. Cloud PlatformsExperience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems Preferred technical and professional experience Define, drive, and implement an architecture strategy and standards for end-to-end monitoring. Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering, Good to have detection and prevention tools for Company products and Platform and customer-facing Role: Data Platform Engineer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills pythondata processingpysparkdata modelingspark data analysismicrosoft azuredata warehousingcloud platformsnumpydata engineeringsqlpandasspring bootetl pipelinesjavagcpkafkadata warehousing conceptshadoopbig dataawsetl
Posted 1 day ago
•
Typically responds within 2 days
Job description As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviour’s. Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modelling results Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Expertise in designing and implementing scalable data warehouse solutions on Snowflake, including schema design, performance tuning, and query optimization. Strong experience in building data ingestion and transformation pipelines using Talend to process structured and unstructured data from various sources. Proficiency in integrating data from cloud platforms into Snowflake using Talend and native Snowflake capabilities. Hands-on experience with dimensional and relational data modelling techniques to support analytics and reporting requirements Preferred technical and professional experience Understanding of optimizing Snowflake workloads, including clustering keys, caching strategies, and query profiling. Ability to implement robust data validation, cleansing, and governance frameworks within ETL processes. Proficiency in SQL and/or Shell scripting for custom transformations and automation tasks Role: Data Engineer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills snowflakesqlpipelinedata ingestionshell scripting pythondata managementperformance tuningtalenddata warehousingcloud platformswarehousedockeransibledatabase designelastic searchjavadevopssplunketlbig dataawsdata integration
Posted 1 day ago
•
Typically responds within 2 days
Job description Design, develop, and maintain applications using Java/J2EE and IBM Infosphere MDM Advanced Edition v11.x. Participate in development and support projects including fail & fix and maintenance activities. Collaborate with clients and internal teams to understand requirements and deliver solutions. Provide timely and effective support for multiple clients, ensuring quick resolution of issues. Engage directly with clients in a client-facing role, ensuring clear communication and understanding of business needs. Participate in on-call support and be flexible to extend support after hours when required. Follow software engineering best practices, including continuous integration and continuous delivery (CI/CD Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 6+ years of hands-on experience in Java/J2EE technologies. 4+ years of hands-on development experience in IBM Infosphere MDM Advanced Edition v11.x. Strong understanding and practical experience with CI/CD tools and practices. Proven experience in development and support projects, including maintenance and issue resolution. Strong client interaction and communication skills, with experience in direct client-facing roles Preferred technical and professional experience Prior experience in the Banking domain or financial services industry. Exposure to Agile methodologies and collaborative development environments. Familiarity with other enterprise data management tools or technologies Role: Webmaster Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills continuous integrationjavacd toolsclient interactionci / cd tools kubernetesdata managementci/cdansibledockersqlplsqlgitdevopslinuxj2eejenkinsshell scriptingibm infospherepythonmavenmdmterraformagileawsj2ee technologiesunix
Posted 1 day ago
•
Typically responds within 2 days
Job description As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our client’s business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Design, develop, and maintain Ab Initio graphs for extracting, transforming, and loading (ETL) data from diverse sources to various target systems. Implement data quality and validation processes within Ab Initio. Data Modeling and Analysis:. Collaborate with data architects and business analysts to understand data requirements and translate them into effective ETL processes. Analyze and model data to ensure optimal ETL design and performance. Ab Initio Components:. . Utilize Ab Initio components such as Transform Functions, Rollup, Join, Normalize, and others to build scalable and efficient data integration solutions. Implement best practices for reusable Ab Initio components Preferred technical and professional experience Optimize Ab Initio graphs for performance, ensuring efficient data processing and minimal resource utilization. Conduct performance tuning and troubleshooting as needed. Collaboration:. . Work closely with cross-functional teams, including data analysts, database administrators, and quality assurance, to ensure seamless integration of ETL processes. Participate in design reviews and provide technical expertise to enhance overall solution quality. Documentation Role: ETL Developer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: DBA / Data warehousing Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills ab initioperformance tuningdata modelingtroubleshootingetl hivepythondata analysisoracledata warehousingdata engineeringsqlplsqldata qualitytableauunix shell scriptingsparkhadoopbig dataawsdata integrationinformaticaunix
Posted 1 day ago
•
Typically responds within 2 days
Job description As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in implementing the same Learn new technologies and implement the same in feature development within the time frame provided Manage debugging, finding root cause analysis and fixing the issues reported on Content Management back end software system fixing the issues reported on Content Management back-end software system Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Overall, more than 6 years of experience with more than 4+ years of Strong Hands on experience in Python and Spark Strong technical abilities to understand, design, write and debug to develop applications on Python and Pyspark. Good to Have;- Hands on Experience on cloud technology AWS/GCP/Azure strong problem-solving skill Preferred technical and professional experience Good to Have;- Hands on Experience on cloud technology AWS/GCP/Azure Role: Data Platform Engineer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: Software Development Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills pysparksparkgcppythonaws hivescalaapache pigsqldockerjavalinuxmysqlhadoopbig dataetlhbasenatural language processingooziemicrosoft azuremachine learningmapreducekafkasqoopunix
Posted 1 day ago
•
Typically responds within 2 days
Job description In the role of Storage Developer, you would be responsible for Designing and development of individual product features for IBM Storage family of storage products, IBM Software Defined Storage portfolio & IBM cloud storage services. This role requires 3-8 years of relevant storage industry experience, preferably with prior experience in designing and developing Storage Software. S/He should have BE in Computer Science and Electronics with proven track record of technical leadership for software development. Should have experience with GoLang/Python, should have experience working with Containers/Openshift/Kubernetes. Responsibilities: As a software Engineer you will be responsible for development, Test and support of Storage product Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 3+ years exp Experience with GoLang/Python Experience working with Containers/Openshift/Kubernetes Experience with RHEL/Linux OS/Openshift OS, system configuration, and administration Ability of problem solving and debugging complex code stacks Strong communication skills and ability to work in small teams with testers and developers Experience with continuous integration tools and automation frameworks Preferred technical and professional experience Knowledge of storage or file system concepts (Linux) Experience with Jenkins, Git, Gerrit, Robot Experience in Agile Software Development and Test Experience in kubernetes operator development is plus Experience in Cloud and Infrastructure Role: Data warehouse Developer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: DBA / Data warehousing Education UG: Any Graduate PG: Any Postgraduate Key Skills Skills highlighted with ‘‘ are preferred keyskills kubernetesgerritgitjenkinspython containerautomation frameworkcsstechnical leadershipopenshiftgolangfile systemsqlrobotjavacomputer sciencelinuxdebugginghtmlmysqlsoftware testingsystem configurationrheljavascriptagileaws
Posted 1 day ago
•
Typically responds within 2 days