Products

Openetl keyboard_arrow_right Documentation keyboard_arrow_right Troubleshooting

Troubleshooting

This document covers common OpenETL issues, debugging procedures, and support resources.

Common Issues

Module Not Found Errors

Symptom: Import errors for openetl or adapter modules

Resolution:

  1. Verify installation: npm list openetl
  2. Reinstall dependencies: npm install
  3. Check package.json for correct package versions

Silent Pipeline Failures

Symptom: Pipeline completes without errors but no data is processed

Resolution:

  1. Verify Vault credentials (client_id, client_secret, refresh_token)
  2. Enable logging to capture error events
  3. Test adapter connection independently
  4. Verify endpoint configuration in connectors

Rate Limit Errors

Symptom: HTTP 429 errors or throttling messages

Resolution:

  1. Configure rate_limiting in pipeline (see Rate Limiting)
  2. Reduce requests_per_second and concurrent_requests
  3. Increase max_retries_on_rate_limit

Debugging Procedures

Enable Event Logging

orchestrator.runPipeline({
  id: 'debug-pipeline',
  source: { /* ... */ },
  logging: event => {
    console.log(`[${event.type}]`, event.message || event);
  },
});

Test Adapter Connections

Isolate connection issues by testing the connect() method:

const adapter = adapterFunction(connector, credentials);
await adapter.connect(); // Test authentication

Isolate Components

Test pipeline components independently:

  1. Test source adapter extraction only (use onload callback)
  2. Test target adapter loading with static data
  3. Test transformations with sample data

Support Resources

Documentation

Community Support

Edit this page on GitHub