DEV.co
Open-Source Databases · cloudquery

cloudquery

CloudQuery is an open-source data pipeline tool that syncs cloud infrastructure metadata, security configs, and billing data from 70+ cloud and SaaS sources (AWS, Azure, GCP, etc.) into data warehouses. It enables platform teams to build cloud asset inventories, CSPM solutions, and FinOps dashboards using SQL queries without writing custom API integrations.

Source: GitHub — github.com/cloudquery/cloudquery
6.5k
GitHub stars
550
Forks
Go
Primary language
MPL-2.0
License (OSI-approved)

Key facts

Objective fields from the source. Values we can't verify are shown as “Unknown” rather than guessed.

FieldValue
Repositorycloudquery/cloudquery
Ownercloudquery
Primary languageGo
LicenseMPL-2.0 — OSI-approved
Stars6.5k
Forks550
Open issues153
Latest releaseplugins-destination-mongodb-v3.1.1 (2026-07-08)
Last updated2026-07-08
Sourcehttps://github.com/cloudquery/cloudquery

What cloudquery is

Written in Go, CloudQuery uses a plugin architecture (source and destination plugins) with Apache Arrow for high-performance data movement. It runs on-premises, extracts cloud metadata via provider APIs, normalizes data, and loads into SQL-queryable destinations—enabling repeatable, scheduled syncs with fine-grained control and no vendor lock-in.

Quickstart

Get the cloudquery source

Clone the repository and explore it locally.

terminalbash
git clone https://github.com/cloudquery/cloudquery.gitcd cloudquery# follow the project's README for install & configuration

Need it deployed, integrated, or customized instead? DEV.co ships production installs.

Best use cases

Multi-Cloud Asset Inventory & Discovery

Unify cloud infrastructure metadata from AWS, Azure, GCP, and SaaS platforms into a centralized queryable warehouse. Enables rapid resource discovery, compliance auditing, and cost allocation across heterogeneous cloud estates.

Cloud Security Posture Management (CSPM)

Continuously sync security configurations, IAM policies, and compliance data into a data warehouse to run normalized SQL queries and detect misconfigurations. Integrate with BI tools or Slack for automated alerting.

FinOps & Cloud Cost Optimization

Aggregate billing and consumption data from multiple cloud providers with normalized schemas. Query and analyze cost patterns, unused resources, and spending trends via SQL without proprietary tool lock-in.

Implementation considerations

  • Requires hands-on provisioning of destination warehouse (Postgres, BigQuery, Snowflake, etc.) and network connectivity to source cloud APIs; not a drop-in SaaS.
  • Plugin ecosystem maturity varies; validate source and destination plugins for your specific cloud providers before committing to production.
  • Scheduling and orchestration (Kubernetes, cron, Airflow) must be managed separately; CloudQuery provides the sync engine, not the orchestration layer.
  • Schema normalization is opinionated; review destination table schemas and transformation logic to ensure alignment with downstream analytics or reporting needs.
  • Initial onboarding and API credential setup requires understanding of cloud provider IAM roles, authentication, and rate limiting to avoid throttling during large-scale syncs.

When to avoid it — and what to weigh

  • Real-Time Event Processing Required — CloudQuery is a batch/periodic sync tool, not a real-time streaming platform. If you need sub-minute latency or continuous event streaming, use cloud-native event systems (EventBridge, Pub/Sub) instead.
  • No SQL Warehouse in Your Stack — CloudQuery requires a destination database or data warehouse (Postgres, BigQuery, Snowflake, etc.). If you lack infrastructure to run or manage a queryable data store, deployment becomes operationally complex.
  • Fully Managed, Zero-Ops Preference — CloudQuery requires running CLI/agent on your infrastructure, scheduling, monitoring, and managing plugin updates. If you need a completely managed SaaS solution with zero operational overhead, commercial CloudQuery Cloud (not evaluated here) or competitor SaaS tools may be preferable.
  • Limited Compatibility with Niche Cloud Providers — While CloudQuery supports 70+ sources, coverage varies by maturity. If you depend on obscure or proprietary cloud APIs, plugin support may be absent or limited, requiring custom plugin development.

License & commercial use

CloudQuery is licensed under Mozilla Public License 2.0 (MPL-2.0), an OSI-approved weak copyleft license. MPL-2.0 permits commercial use, modification, and distribution, with the obligation to disclose source code changes to MPL-covered files. Files not changed remain private; this applies file-by-file, not project-wide copyleft.

Commercial use is permitted under MPL-2.0. You may use CloudQuery in proprietary products or SaaS offerings without paying royalties. However, any modifications you make to CloudQuery source files must be released under MPL-2.0. If you distribute CloudQuery (modified or unmodified) to third parties, include the license notice. Requires legal review for specific commercial deployment models (e.g., embedding in proprietary SaaS, resale). The README notes some code has moved to closed source; review the provided CSV/zip assets if your use depends on legacy modules.

DEV.co evaluation signals

Editorial assessment — not user reviews. Directional, with an explicit confidence level.

SignalAssessment
MaintenanceActive
DocumentationStrong
License clarityClear
Deployment complexityModerate
DEV.co fitStrong
Assessment confidenceHigh
Security considerations

Runs on your infrastructure; cloud data does not touch CloudQuery's servers, reducing third-party data exposure. Security posture depends on: (1) secure storage and rotation of cloud provider credentials, (2) network isolation of destination warehouse, (3) IAM roles following least-privilege principle, (4) monitoring and auditability of sync jobs. No mention of encryption in transit/at-rest details; requires manual configuration at destination. Review plugin code and dependencies for supply-chain risks, especially if running in regulated environments.

Alternatives to consider

Airbyte

General-purpose ELT platform with 300+ connectors. Broader integrations but less specialized for cloud infrastructure and CSPM use cases; more opinionated on transformation layer.

Steampipe

Cloud infrastructure query tool using SQL-based plugin model (also Go-based). Focuses on ad-hoc querying and compliance checks rather than scheduled data warehouse syncs; different UX/architecture.

Wiz / Lacework / Snyk

Commercial CSPM/security platforms with built-in cloud integrations, managed SaaS, and proprietary analytics. Higher cost but zero operational overhead; suitable if managed CSPM is priority over data warehouse flexibility.

Software development agency

Build on cloudquery with DEV.co software developers

Evaluate CloudQuery's plugin coverage for your cloud providers and destination warehouse. Start with a proof-of-concept sync to validate schema and performance before production deployment.

Talk to DEV.co

Related open-source tools

Surfaced by semantic similarity across the DEV.co open-source index.

Related on DEV.co

Explore the category and the services that help you build with it.

cloudquery FAQ

Can I use CloudQuery to sync data without a data warehouse?
Not practically. CloudQuery's value is exporting normalized, queryable cloud metadata into SQL-accessible destinations. Local file outputs exist, but the intended use case is warehouse integration. You must provision or manage a destination database.
Does CloudQuery support real-time syncing?
No. CloudQuery is batch/periodic; it runs on a schedule (e.g., hourly, daily). For real-time cloud events, use cloud-native event services (AWS EventBridge, GCP Pub/Sub, Azure Event Grid) in parallel.
What if I need a custom source or destination plugin?
CloudQuery provides an open plugin SDK in Go. You can write custom plugins, but this requires Go expertise and ongoing maintenance. For simple use cases, prefer existing plugins; custom development is a sustained cost.
Is there a managed/SaaS version?
Yes, CloudQuery Cloud (commercial offering) exists but is separate from this open-source repo. This evaluation covers the open-source CLI/framework only. Commercial SaaS adds managed hosting and support; not evaluated here.

Custom software development services

DEV.co is a software development agency delivering custom software development services to companies building on open source. Our software developers and web developers design, integrate, and ship production systems — spanning web development, APIs, AI, data, and cloud. If cloudquery is part of your open-source databases roadmap, our team can implement, customize, migrate, and maintain it.

Ready to Unify Your Cloud Data?

Evaluate CloudQuery's plugin coverage for your cloud providers and destination warehouse. Start with a proof-of-concept sync to validate schema and performance before production deployment.