Pyspark kubernetes jobs
I'm in need of a Machine Learning Engineer who can migrate our existing notebooks from RStudio and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and...
I am on the lookout for a seasoned EKS Kubernetes expert. My primary tasks that need help with include deployment and scaling, configuration and management, troubleshooting, debugging, and key upgrades. The EKS upgrades should ideally empower our system with improved performance, as well as apply important bug fixes and patches. The current Kubernetes platform I'm utilizing is on the cloud, specifically AWS, Azure, and GCP. Ideal Skills & Experience: - Proficiency in deploying, scaling, and managing Kubernetes clusters - Expertise in troubleshooting and debugging on Kubernetes - Familiarity with AWS, Azure, and GCP platforms - Proven track record of successful Kubernetes upgrades improving performance and fixing bugs.
...troubleshoot production issues, ensuring swift resolution. - Manage Docker container setups and Kubernetes orchestrating the deployment, scaling, and management of containerised applications. - Collaborate with team members to improve the existing infrastructure and explore options for new technologies and automation. - Implement automation tools and frameworks (CI/CD pipelines). - Conduct systems tests for security, performance, and availability. - Develop and maintain documentation and systems diagrams. **Required Skills and Qualifications:** - Proven experience as a DevOps Engineer or similar software engineering role. - Proficient with AWS cloud services. - Expertise in Docker and Kubernetes. - Strong background in Linux/Unix Administration. - Experience with CI/CD sys...
I'm looking for a developer with extensive experience in both the MERN (MongoDB, , React, Node.js) stack and Kubernetes. The project will involve creating a comprehensive and scalable web application with the following functionalities: - Full user authentication capabilities - Real-time data processing features - E-commerce functionalities The ideal candidate will have: - Proficiency in the MERN stack - Hands-on experience with Kubernetes, specifically in deployment, scaling, and monitoring - A track record of fully integrating the MERN stack with Kubernetes - Strong problem-solving skills and a proactive approach to finding efficient solutions - Excellent communication and collaboration skills to work with our team effectively This is an urgent project with th...
I'm looking for an adept professional who can create an Android virtualization solution. This solution should be flexible enough to be used on micromachines on AWS Amazon or any other system via Docker or Kubernetes. The end goal is to enable the running of multiple, simultaneous Android cell phones. Key Aspects: - It must support Google Play, Google Drive, and specifically, WhatsApp. - The main purpose of this project is virtual phone farming. - The solution should automate the process of sending and receiving WhatsApp messages. Android virtualization solution, which can be used on Micromachines on AwsAmazon or Any system via Docker or Kubernets, which allows you to run a series of simultaneous cell phones on Android, with Gplay, GdRIVE, Whatsapp, edit version, resolution, m...
I am seeking a skilled developer to deploy an Azure Kubernetes Service (AKS) using Terraform. This should also include a DevOps yaml pipeline with custom Azure CLI tasks, as opposed to marketplace tasks. Key Components: - Azure Kubernetes Deployment: This involves deploying an AKS that ensures security, compliance, scalability, and load balancing, as well as seamless integration with other Azure services. - DevOps Yaml Pipeline: The setup should include a DevOps yaml pipeline with custom Azure CLI tasks instead of marketplace tasks. - Service Deployment: The provision to deploy services to the Kubernetes cluster, such as Flagsmith through the same setup would be an added advantage. Ideal Skills & Experience: - Proven experience deploying Azure services using ...
Azure Azure Devops AWS Jenkins Terraform Kubernetes Docker Ansible Ansible tower Git hub Git Linux Monitoring with third party tools Sonarcube, veracode. Scripting: python, bash, powershell
...knowledge and skills in various technologies including understanding of the Amazon Web Services (AWS) platform, Kubernetes (specifically K3S), ServiceLB, Traefik for ingress, and S3 for backups. Help me via Video Call to achieve the following Key Tasks: * Set-up PostgresDB using CrunchyData PGO on my existing K3S cluster * Implement external access with TLS using Traefik for ingress along with ServiceLB * Configure the deployment to be highly available * Integrate daily backups on S3 * Automate all the above using and existing Terraform infrastructure as well as HELM and Kustomize Skills and Experience: * Proficient in working with AWS, particularly EC2 and S3 * Experience with Kubernetes, specifically K3S and ServiceLB * Understanding of how to use Traefik for ingress ...
I am looking for a Kubernetes expert who can help me in setting up a GitHub Action Self Hosted Runner on my existing Kubernetes cluster.
...stack developer with proficiency in Python and experience in GenerativeAI, particularly LLM. You will be primarily tasked with frontend and backend development. Job Summary: is seeking a seasoned Senior Backend Developer with extensive experience in full-stack development, Docker container management, API design, and integration, as well as proficiency in React, Firebase, and Kubernetes. The ideal candidate will help elevate our backend systems, ensuring scalability, performance, and security to drive IntraIntel to the forefront of artificial intelligence solutions. Experience with LLM is important. Key Responsibilities: 1. React and Server-Side Development: • Develop and maintain scalable, responsive front-end architecture. • Implement server-side logic using Node...
Hi I am looking to setup a personal cloud using open stack and setup a containers with peer to peer technologies . I need a skilled DevOps professional with strong expertise in handling containerized applications using Docker or Kubernetes . Aspects of the job include: - Setting up and managing my containerized applications. - Operating primarily within a Linux environment. - Implementing Continuous Integration/Continuous Delivery (CI/CD) pipelines to enhance software delivery efficiency. - Monitoring and scaling infrastructure as per requirements. It's important that you have profound experience with Docker, Linux system and strong familiarity with CI/CD methodologies.
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependenci...Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framewor...
Hi, Please apply only individual. Agency can apply but budget should not be more than mentioned. Role : GCP Engineer (OTP) Exp : 7 + yrs SHIFT: IST Cloud Storage Buckets, BigQuery (SQL, Data Transformations and movement) Airflow (python, DAGs), DBT IAM Policies PyCharm Databricks (pySpark), Azure DevOps Clear and confident communication
...an infrastructure perspective across multiple clouds. Key Qualifications: 5+ years of engineering experience. Proven SRE or DevOps expertise. Strong experience with Kubernetes and Kubernetes operators. Ability to understand, write and review code in Go. Solid experience with AWS cloud infrastructure. GCP/Azure would be a plus. Skilled in observability practices. Contributions to open-source projects are a significant plus. Initiative at the level of independent project/task management. The position expects on-call shifts during working hours. Preferable time zone for this role is GMT+0 - GMT+4 Technology Stack: AWS, Kubernetes, Go, Terraform, Postgres (RDS), VictoriaMetrics and Prometheus ecosystem, Grafana, Karpenter, ArgoCD, GitHub, React. About VictoriaMetrics: W...
Seeking a determined and versatile DevOps professional with an emphasis in Kubernetes and cloud-native technologies. Do indicate your familiarity with these tools in your application.
I'm in need of a Machine Learning Engineer who can migrate our existing notebooks from RStudio and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and...
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependenci...Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framewor...
...applications. - Stay up-to-date with emerging trends and technologies in cloud infrastructure and microservice design. *Qualifications:* - Strong proficiency in Python and web application development. - Proven experience in designing microservice architectures. - Familiarity with cloud service providers such as AWS, GCP, or Azure. - Knowledge of containerization and orchestration tools like Docker and Kubernetes. - Excellent problem-solving skills and attention to detail. *What We Offer:* - An opportunity to work on cutting-edge projects in a fast-paced, innovative environment. - A collaborative team culture that values individual creativity and growth. - Competitive salary and benefits package. If you are passionate about Python, cloud computing, and microservice architecture...
...applications. - Stay up-to-date with emerging trends and technologies in cloud infrastructure and microservice design. *Qualifications:* - Strong proficiency in Python and web application development. - Proven experience in designing microservice architectures. - Familiarity with cloud service providers such as AWS, GCP, or Azure. - Knowledge of containerization and orchestration tools like Docker and Kubernetes. - Excellent problem-solving skills and attention to detail. *What We Offer:* - An opportunity to work on cutting-edge projects in a fast-paced, innovative environment. - A collaborative team culture that values individual creativity and growth. - Competitive salary and benefits package. If you are passionate about Python, cloud computing, and microservice architecture...
I am need help to setup K6 load testing in k8s and CI/CD. Key Responsibilities: - Setting up and configuring a Kubernetes cluster - Developing and executing effective load tests using K6 - Implementing CI/CD pipelines for automated deployment I am following "" and getting error in "Build and install the k6-operator" step. after "cd dependencies/k6-operator make deploy cd ../.." i get error "panic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x2 addr=0x0 pc=0x101210604]". i need help to get rid of this error and run the test in the cluster and add it to the ci/cd. i will also
...machine learning technologies, including recommendation systems, personalization algorithms, and natural language processing 3. Strong proficiency in programming languages such as Python, Java, and C++, as well as web development frameworks like Node.js and React 4. Experience with cloud computing platforms such as AWS, Azure, or Google Cloud, and containerization technologies like Docker and Kubernetes 5. Familiarity with data engineering and analytics tools and techniques, such as Hadoop, Spark, and SQL 6. Excellent problem-solving and analytical skills, with the ability to break down complex technical challenges into manageable components and solutions 7. Strong project management and communication skills, with the ability to collaborate effectively with both technical an...
I am looking for a dedicated specialist well-versed in using Databricks and PySpark for data processing tasks, with a primary focus on data transformation. With the provision of JSON format files, you will perform following tasks: - Carry out complex data transformations - Implement unique algorithms to ensure efficient data processing - Test results against required benchmarks Ideal Skills: - Proficient in Databricks and PySpark. - Must possess a solid background in data transformation. - Experience handling large JSON datasets. The end goal is to achieve seamless data transformation leveraging the power of Databricks and PySpark, enhancing our ability to make informed business decisions. Please provide your completed projects, and the strategies you've used ...
I'm seeking an expert in DevOps, specifically comfortable with Kubernetes, to assist me in my role. This will involve a focus on deploying applications, networking, scaling, and monitoring. The requirements include, but aren't limited to, the following tools: - Kubespray - Flux - Githubactions - Istio - Prometheus - - Equinix baremetal server - Cillium The ideal candidate should have extensive experience with these tools and a deep understanding of their functionalities. This role will require daily assistance on an ongoing basis for more than three months. Support hours will adhere to Melbourne time. Preferred means of Communication: - Phone calls - Video calls - Messaging/chat If you're adept in Kubernetes and can provide the necessary long-term ...
I am looking for a seasoned...Copilot, and Azure Data Factory. This project will also use Azure Kubernetes to ensure that the analytics processes are scalable. The main goal is to augment our standard business processes and make them more effective by leveraging these technologies. The data to be analyzed is structured and originates from various sources like Excel, CSV, SQL, etc. Ideal skills for this project include: - Proficient in AI analytics with a solid understanding of data analysis, predictive modeling, and natural language processing. - Experience with Azure Databricks, Azure Data Factory, and Azure Data Lake storage. - Knowledge and experience in working with structured data. - Familiarity with ML and the Copilot tool. - Experience in Azure Kubernetes for scala...
I need to set up an AWS environment to host my web applications and run Kubernetes with the help of Terraform. Here are the specifics: - Services I plan on using: EC2, RDS, S3, Kubernetes, and Terraform - EC2 instances will be used specifically for hosting web applications - Autoscaling is required for the EC2 instances to handle high traffic The ideal candidate for this job should have experience with: - AWS services, especially EC2, RDS, and S3 - Terraform and Kubernetes - Implementing and configuring autoscaling for EC2 instances - Understanding of web application hosting on EC2 If you have prior experience in setting up similar environments and have the skills needed for this project, please feel free to bid.
I am in need of a Kubernetes expert to help me set up a Kubernetes cluster. The purpose of this cluster is to scale applications and manage containerized workloads more efficiently. Key Responsibilities: - Set up a Kubernetes cluster on a Linux operating system - Ensure the cluster is capable of handling between 5 to 10 nodes - Provide guidance on how to efficiently manage the cluster and ensure high availability Ideal Skills and Experience: - Proven experience in setting up and managing Kubernetes clusters - Deep understanding of containerization and scaling applications - Familiarity with Linux operating systems - Strong problem-solving and troubleshooting skills - Excellent communication and customer service skills I am looking for a freelancer who is re...
As a beginner to Kubernetes and Kubespray, I am seeking an expert able to provide me with a comprehensive understanding of k8s deployment using Kubespray. Looking for a combination of strategies: - Step-by-step tutorials that walk me through the basics and complexities of Kubespray, along with providing best practices. - Hands-on training opportunities so I can apply what I learn in real-time and become proficient. The focus is primarily on deploying to dedicated servers. I need someone with: - Proficiency in Kubernetes and Kubespray - Ability to create engaging, easy-to-understand tutorials - Strong coaching skills with practical, hands-on training experience - Expertise with deployment on dedicated servers By the end of this project, I aim to deploy confidently and effe...
I'm a beginner in Kubernetes eager to learn the ropes from a seasoned professional. Ideally, I'm looking to gain knowledge and familiarity on: - Managing a Kubernetes cluster - Kubernetes networking - Security within Kubernetes - upgrading the k8s cluster - upgrading the application in the k8s cluster. K8s is deployed in equinix bare metal server using kubespray. Ci - github actions and CD - Flux cd Since our organization primarily uses Linux for our Kubernetes clusters, a strong background in Linux-based Kubernetes is a must. As your mentee, I'm hoping you can guide me and provide hands-on experience in these areas. Your invaluable insights will help empower me to manage our Kubernetes setup effectively. Required skills ...
Position Golang Developer Experience : 4 plus Work Location Remote JD Role & responsibilities Must Have Skills:- * 4 plus years of experience with Kubernetes Operator Development using Golang. Also, experience in using Data Structures/Algorithms in Golang. * Candidate must have understanding of working experience including design and development with Kubernetes Custom Resources and Controller. * 4 years of experience developing large-scale infrastructure, distributed systems or networks, or experience with containerized application deployment on Kubernetes. * Broad understanding of Kubernetes concept: Deployment, Pod, Secret, ConfigMap. Preferred Skills:- * Experience with gRPC client-server programming on Golang. * Understanding and experience with Helm c...
We have set up our development AKS & ACR as mentioned above, where we have been deploying till now, and now we want to start our production environment. We want to set-up a CI/CD pipeline for our application. Once we push the latest code to the release branch in Azure Repo, it should trigger the CI pipeline. The pipeline should build and push the docker image to the ACR and update the Kubernetes cluster without any errors. After a successful build, the CD pipeline should collect the artifacts files and start the release. We want to have a training session for our team. We want to have a screen recording session as well. We want explanations on the Kong Api gateway & ingress nginx controller setup.
...Engineer with the following qualifications: 1. Proficiency in VueJS, JavaScript, and Python. 2. Hands-on experience with MySQL and PostgreSQL. 3. Familiarity with relational database systems. 4. Experience with API design and development. 5. Knowledge of cloud based technologies such as AWS, Azure, or Google Cloud. 6. Familiarity with containerization and orchestration technologies like Docker and Kubernetes. 7. Experience with continuous integration and continuous deployment (CI/CD) pipelines. Your responsibilities will include using a combination of these languages to develop and maintain software applications. The ideal candidate will be innovative, possess strong problem-solving skills, and demonstrate exceptional attention to detail. Previous experience in similar roles is...
I am in ne...Python-based API and deploy it in GCP using Google Kubernetes Engine (GKE). Key requirements: - Proficient in Python: The API should be developed in Python, so a strong understanding of the language and its frameworks is essential. - Experience with GCP: Prior experience working with Google Cloud Platform is required, as the API will be deployed in GKE. - Kubernetes Knowledge: A deep understanding of Kubernetes is necessary to deploy the API to GCP effectively. - Strong Problem-solving Skills: As the primary purpose of the API is to interact with GCP, the developer should be able to think critically and solve complex issues that may arise during development and deployment. Ideal skills and experience for the job: - Python - Google Cloud Platform - K...
Important Note: - You should b...Full Stack Engineer. Your skillset should include: - Proficiency in VueJS, JavaScript and Python - Hands-on experience with MySQL and PostgreSQL - Familiarity with relational database systems - Experience with API design and development - Experience with cloud based technologies such as AWS, Azure or google cloud - Knowledge of containerization and orchestration technologies such as Docker and Kubernetes - Familiarity with continuous integration and continuous deployment(CI/CD) pipelines Your task will involve combining all these languages in the creation and maintenance of software. To ace this job, you should be innovative, possess strong problem-solving skills, and have impressive attention to detail. Successful experience in similar roles is p...
I am in need of an experienced Kubernetes expert to assist me in both consultancy and implementation. The primary goal of this project is to improve my application deployment processes. I have a pressing need for this to be completed as soon as possible. Key Responsibilities: - Provide expert consultation on Kubernetes best practices - Implement Kubernetes setup and configuration - Optimize application deployment processes within Kubernetes - Troubleshoot and resolve any issues that may arise during implementation Ideal Skills: - Extensive experience in working with Kubernetes - Previous consultancy experience is desirable - Proven track record of improving application deployment processes - Ability to work quickly and efficiently, given the immediate n...
I am in need of a DevOps Engineer with proficiency in operating Linux, Windows, and macOS systems. Key Skills Required: - Experience with Docker, Kubernetes, and Jenkins, which are essential tools for this project. - Knowledge of configuration management tools is craved, ideally Ansible, Chef, and Puppet. Your breadth of understanding of DevOps technologies and tools will be a significant advantage for this task. A history of managing diverse OS environments and taking care of configuration management will place you in a strong position for this project.
...functions to handle data quality and validation. -Should have good understanding on S3,Cloud Formation, Cloud Watch, Service Catalog and IAM Roles -Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. -Should have good knowledge about Tableau, with creating Tableau Published Datasets and managing access. -Write PySpark scripts to process data and perform transformations.(Good to have) -Run Spark jobs on AWS EMR cluster using Airflow DAGs.(Good to have)...
...• Technical Skills & Experience: • Minimum 5+ years of experience as an Application Architect or similar role. • Proven experience in designing and implementing cloud-native applications. • Strong understanding of data visualization and analytics principles. • In-depth knowledge of cloud computing concepts and best practices (AWS, Azure). • Expertise in containerization technologies (Docker, Kubernetes) is a plus. • Familiarity with open-source data ingestion, processing, storage, visualization, and analytics tools (e.g., Apache Kafka, Spark, Superset, etc.) is a plus. Deliverables: • Detailed cloud-native architecture document for the visualization and analytics platform. • Translate the overall architecture into a specific AWS c...
I need several services running on Digital Ocean to be migrated on Kubernetes Clusters , the current services are running on docker so should be a straight forward process. Some services might need to be updated like their version. Docker Kubernetes Migrate DB Migrate Configs
...Stay current with new technology options and vendor products, evaluating which ones would be a good fit for the company Troubleshoot the system and solve problems across all platform and application domains Oversee pre-production acceptance testing to ensure the high quality of a company’s services and products Skill Sets: Strong development experience in AWS Step Functions, Glue, Python, S3, Pyspark Good understanding of data warehousing, Large-scale data management issues, and concepts. Good experience in Data Analytics & Reporting and Modernization project Expertise in at least one high-level programming language such as Java, Python Skills for developing, deploying & debugging cloud applications Skills in AWS API, CLI and SDKs for writing applications Knowledge...
PLEASE STOP APPLYING IF YOU DONT READ, UNDERSTAND AND/OR CAN NOT DELIVER. EVEYTHING IS WRITTEN HERE, ALSO IF YOU DONT HAVE A BASE ATTITUDE OF COMMUNICATION ONLY INDIVIDUALS SHOULD APPLY. START IMMEDIATELY. SOLVING AND CAN DO ATTITUDE, for 3 days. TASKS ON THE FLY. WE WORK TOGETHER AND I ASSIGN TASKS TO YOU. Wanted skills - Proxmox in deep (firewall function) - opnsense - subneting - kubernetes - windows 2022 server - Linux - Scripting - email, how traffic goes, services, egroupware - GPO, Security, Google Admin
I'm looking for an experienced DevOps expert who excels in Azure and Kubernetes. In particular, we are aiming to automate and scale our operations for cost optimization. Key project goals: - Achieve a reliable and efficient deployment process through automation - Seamlessly integrate Azure and Kubernetes - Manage infrastructure in a cost-effective way Time is of the essence for us, as we need this project completed ASAP. Skills and Experience: - Expert in Azure and Kubernetes - Proven track record in cost optimization and scalability - Extensive experience with automation - Proven history of managing projects on tight deadlines.
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and troubleshooting. Unfortunately, I can't specify the type of errors– I need a professional to help identify and rectify them. If you are an experienced PySpark coder with a keen eye for bug identification and problem solving, I'd appreciate your expertise.
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and troubleshooting. Unfortunately, I can't specify the type of errors– I need a professional to help identify and rectify them. If you are an experienced PySpark coder with a keen eye for bug identification and problem solving, I'd appreciate your expertise.
I'm searching for a PySpark expert who can provide assistance on optimizing and debugging current PySpark scripts. I am specifically focused on PySpark, so expertise in this area is crucial for the successful completion of this project. Key Responsibilities: - Optimizing PySpark scripts to improve efficiency - Debugging current PySpark scripts to resolve existing issues Ideal Candidate: - Proficient with PySpark - Experience in big data management, data ingestion, processing, analysis, visualization, and reporting - Strong problem-solving skills to identify and resolve issues effectively - Knowledgeable in performance tuning within PySpark.
I'm looking for a skilled freelancer to create a Spark script that transfers data from a Hive metastore to an S3 bucket. The goal of this project is to enable backup and recovery. Skills and Experience: - Proficiency in Spark and Hive - Extensive experience with S3 buckets - Understanding of data backup strategies Project Details: - The script needs to read the schema and perform metadata transfer for selected schema to s3 bucket. - Only bid if you have work experience with spark, hive, s3 - 4 schemas needs to be migrated - I have already got access to s3 configured - I have local instance of netapp s3 available and bucket created. - Server is Ubuntu
I'm currently in need of a proficient DevOps Engineer who is well-versed with AWS. Key elements of this project involve: - Setting up Continuous integration & deployment - Implementing Infrastructure as code - Use of Kubernetes Note that familiarity with Docker, Jenkins, or Ansible would be highly beneficial, but it is not a strict requirement for this job. Proven experience in working with AWS and a solid understanding of CI/CD principles, IaC, and Kubernetes is essential. Efficiency and attention to detail are imperative for this role.
...expertise of a seasoned web developer with a demonstrated knowledge of HTML/CSS, Rust, AWS/Kubertes, and Bash to create specialized web pages. The function of these pages is primarily to update OpenWRT routers and AWS databases. Key requirements include: - Designing and developing the pages according to a specific layout I have - Expertise in HTML/CSS, Rust, AWS/Kubernetes, and Bash is a must - High level proficiency in AWS and Kubernetes deployments - Experience with OpenWRT or other router firmware is highly desirable - Excellent attention to detail and the ability to deliver a user-friendly interface Please respond with interest and availability to open the discussion, if this project aligns with your profile and capabilities. I look forward to working with a d...
More details: What specific tasks are you looking to accomplish with an Azure DevOps contract worker? Configuration management, Continuous integration and deployment, Test management, Data Pipeline Infra setup, Containers up and running and network setup, Roles and permissions setup, Kubernetes and Terraform knowledge Are you looking for a freelancer with experience in Kubernetes and Terraform? Yes Which of these tasks will be a top priority for the Azure DevOps contract worker? Data Pipeline Infra setup
I am looking for an experienced data analyst who is well-versed in PySpark to clean up a medium-sized dataset in a CSV file format. The file contains between 10k-100k rows, and your primary role will be to: - Remove duplicate data entries - Deduplicate the dataset - Handle missing values - Aggregate the resultant data Your proficiency in using PySpark to automate these processes efficiently will be critical to the success of this project. Therefore, prior experience in handling and cleaning similar large datasets would be beneficial. Please note, this project requires precision, meticulousness, and a good understanding of data aggregation principles.
