Artmac · 17 hours ago
Senior Fluent Bit Engineer - Log Forwarding, Elasticsearch & Kubernetes
United States
Full-time
Remote
Senior Level, Lead/Staff
8+ years exp
Maximize your interview chancesDigital MarketingInformation Technology
Insider Connection @Artmac
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design and implement log-forwarding configurations using Fluent Bit for various use cases, including application logs, system logs, and container logs.
Optimize data pipelines for performance, scalability, and minimal resource consumption.
Experience with Fluent Bit plugin development.
Understanding of distributed systems and microservices architecture.
Certification in cloud platforms or DevOps practices.
Strong problem-solving skills and the ability to work independently or collaboratively.
Excellent written and verbal communication skills for documentation and collaboration.
Write and manage Fluent Bit configuration files, including input, filter, and output plugins.
Maintain and troubleshoot Fluent Bit instances to ensure high availability and reliability.
Integrate Fluent Bit with log aggregation tools such as Elasticsearch, Splunk, AWS CloudWatch, Kafka, and others.
Collaborate with DevOps, infrastructure, and software development teams to align log forwarding with organizational monitoring and observability strategies.
Set up monitoring and alerting for Fluent Bit instances to proactively identify and resolve issues.
Continuously optimize log-forwarding processes for latency, throughput, and resource utilization.
Create and maintain documentation for Fluent Bit configurations and best practices.
Train team members and stakeholders on Fluent Bit usage and troubleshooting.
Proficiency in setting up and configuring Fluent Bit for diverse log-forwarding needs.
Strong understanding of log processing, formats (JSON, Syslog, etc.), and related concepts.
Hands-on experience with log aggregation platforms like OpenSearch, Elasticsearch, Splunk, and Prometheus.
Experience with scripting languages such as Python, Shell, or similar for automating log-forwarding tasks.
Knowledge of C programming (optional but beneficial for custom Fluent Bit plugin development).
Familiarity with containerization tools (Docker, Kubernetes) and their logging architectures.
Experience working in cloud environments (Azure).
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
8 to 20 years of experience
Design and implement log-forwarding configurations using Fluent Bit for various use cases, including application logs, system logs, and container logs.
Optimize data pipelines for performance, scalability, and minimal resource consumption.
Experience with Fluent Bit plugin development.
Understanding of distributed systems and microservices architecture.
Certification in cloud platforms or DevOps practices.
Strong problem-solving skills and the ability to work independently or collaboratively.
Excellent written and verbal communication skills for documentation and collaboration.
Write and manage Fluent Bit configuration files, including input, filter, and output plugins.
Maintain and troubleshoot Fluent Bit instances to ensure high availability and reliability.
Integrate Fluent Bit with log aggregation tools such as Elasticsearch, Splunk, AWS CloudWatch, Kafka, and others.
Collaborate with DevOps, infrastructure, and software development teams to align log forwarding with organizational monitoring and observability strategies.
Set up monitoring and alerting for Fluent Bit instances to proactively identify and resolve issues.
Continuously optimize log-forwarding processes for latency, throughput, and resource utilization.
Create and maintain documentation for Fluent Bit configurations and best practices.
Train team members and stakeholders on Fluent Bit usage and troubleshooting.
Proficiency in setting up and configuring Fluent Bit for diverse log-forwarding needs.
Strong understanding of log processing, formats (JSON, Syslog, etc.), and related concepts.
Hands-on experience with log aggregation platforms like OpenSearch, Elasticsearch, Splunk, and Prometheus.
Experience with scripting languages such as Python, Shell, or similar for automating log-forwarding tasks.
Familiarity with containerization tools (Docker, Kubernetes) and their logging architectures.
Experience working in cloud environments (Azure).
Bachelor's degree or equivalent combination of education and experience.
Preferred
Knowledge of C programming (optional but beneficial for custom Fluent Bit plugin development).
Company
Artmac
Artmac provides Digital, consulting and Management IT services to clients globally - As your trusted partner, let’s reimagine how your business gets done.
11-50 employees
H1B Sponsorship
Artmac has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
2022 (1)
2021 (3)
Funding
Current Stage
Early StageCompany data provided by crunchbase
