Perception Engineer

Apply Description At OKSI, we believe in owning problems end to end — from first concept through final delivery. We see it through! If you're looking for a place where you can take real ownership, stretch your skills, a place to grow your career while owning meaningful, mission-driven work, this is where you belong. OKSI is seeking a Perception Engineer to architect and implement perception, detection, tracking, and pose estimation algorithms across EO/IR, multi-spectral imagery, and other sensing modalities. The successful candidate will drive the full pipeline — from dataset curation and model development through real-time embedded deployment, simulation-based and hardware-in-the-loop testing, and integration with flight and mission software — working closely with software, hardware, and mission teams. WHAT YOU'LL GET TO DO Algorithm & Model Development • Drive the architecture for image processing, object detection, tracking, and pose estimation pipelines for next-generation spacecraft and sensing platforms • Design and implement robust perception, detection, segmentation, and tracking algorithms (CNN/Transformer-based, e.g., Retina/FCOS/DETR/Mask2D/video models) in C++ and Python • Build and refine model architectures for EO/IR and multi-spectral imagery, driving foundation-scale datasets, training recipes, and robust generalization to long-tail and degraded conditions • Train and fine-tune models in PyTorch, with rigorous experiment tracking and reproducible training pipelines Data, Training & Evaluation • Build large, diverse datasets and labeling/QA pipelines, including augmentation strategies • Stand up training and evaluation pipelines (PR/ROC, mAP, latency, robustness suites), with continuous regression testing and model-update loops from field data • Perform statistical analysis to support algorithm characterization and verification Real-Time Deployment & Optimization • Optimize models for real-time embedded inference (quantization/pruning, TensorRT/ONNX Runtime), profiling CPU/GPU performance to meet tight throughput and latency targets on embedded (e.g., Jetson-class) hardware • Apply model compression techniques (INT8/FP16) and dive into CUDA backends for performance optimization and debugging • Combine vision outputs with auxiliary sensing (radar/LiDAR/RF) for confirm/deny, association, and track management using decision-level fusion Test, Verification & Integration • Test and verify algorithms via software-in-the-loop (SIL) and hardware-in-the-loop (HIL) simulation, using high-fidelity sensor models and real-world datasets • Create visualization, triage, and root-cause analysis tools for rapid insight from simulation, HIL, and flight logs • Define end-to-end test plans in coordination with hardware and flight teams • Instrument health metrics, drift detection, and graceful degradation logic; write clear tests and documentation mapped to performance requirements • Work with the software team to integrate algorithms into flight software Requirements REQUIRED QUALIFICATIONS • Bachelor's degree in Computer Science, Robotics, Electrical Engineering, or a similar discipline (or equivalent experience) • 2+ years of experience implementing perception and tracking algorithms deployed in real-world systems; extensive experience (7+ years) with a track record of shipping ML models to production preferred for senior-level roles • Strong production-level C/C++ on Linux and Python for ML and tooling, with a rigorous approach to profiling, optimization, and testing • Experience with modern detection/segmentation/tracking model architectures and training/fine-tuning in PyTorch • Demonstrated ability to work in a multidisciplinary team and solve complex problems using first-principles approaches • EO/IR imagery experience and experience working with real flight or test data in challenging environments • Passion for advancing capabilities related to space domain awareness, space security, and/or mission-critical sensing systems PREFERRED QUALIFICATIONS • Master's or PhD in Computer Science, Robotics, or a similar discipline • Deep technical expertise in one or more of: SLAM, nonlinear filtering, image processing, object detection, computer vision, or pose estimation • Multi-modal perception experience (EO/IR combined with radar/LiDAR/RF) at the feature or decision level • Experience with robustness and safety testing: adversarial/rare-event testing, long-horizon reliability metrics, and dataset shift/drift monitoring • Physics-aware imaging experience: radiometric correction, NUC/FFC, atmospheric effects modeling, and synthetic data/simulation for coverage • Familiarity with MLOps and data infrastructure: SQL/Parquet, dataset/versioning tools, CI-based validation, and scalable multi-GPU training DESIRED COMPETENCIES • Strong analytical and problem-solving skills, with the ability to evaluate complex system performance and propose effective solutions • Excellent verbal and written communication and cross-functional collaboration skills • Self-motivated, with the ability to work independently and within a team-oriented environment • Strong initiative, ownership of work products, and commitment to continuous improvement • Attention to detail and strong organizational skills, with the ability to manage multiple priorities and meet deadlines Compensation and Benefits $115,000 - $145,000 annually. New hires are typically brought into the organization at a salary between the range minimum and the salary range midpoint depending on qualifications and the budget allocated for this role. Medical, dental, vision fully paid by the employer for the employee Three weeks vacation Automatic company contribution to 401K – 5% of earned wages (no matching required) Educational assistance Why OKSI? See your work fielded fast. Get hands-on with hardware and watch it deployed to customers within months, not years. Build next-generation defense technology. Our engineering work protects warfighters, reduces collateral damage, and safeguards civilians. Speed and Accuracy We move quickly, and you'll see your work through from concept to deployment — not just one slice of the pipeline; no process bottlenecks we move with speed and agility ! Hybrid schedule Working at OKSI provides you with a unique opportunity to see fruition of your work while still having a real work-life balance with our hybrid schedule options. Professional Growth . OKSI is expanding and growing, which means faster-than-typical opportunities to advance your career. ITAR Requirements To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. 1157, or (iv) Asylee under 8 U.S.C. 1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here . We are an equal employment opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, protected veteran status, or any other status protected by law. We provide reasonable accommodations for qualified individuals with disabilities in the application and hiring process. This employer participates in E-Verify.