Skip to content

Load: Support same measurement name and type with different encoding and compression#17152

Merged
jt2594838 merged 5 commits intoapache:masterfrom
luoluoyuyu:support-same-measurement-different-encoding-compression
Feb 4, 2026
Merged

Load: Support same measurement name and type with different encoding and compression#17152
jt2594838 merged 5 commits intoapache:masterfrom
luoluoyuyu:support-same-measurement-different-encoding-compression

Conversation

@luoluoyuyu
Copy link
Member

Description

As the title said


This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

…mpression

This PR allows measurements with the same name and type to have different
encoding and compression types during TsFile loading. Previously, duplicate
measurements would throw an exception. Now, if measurements have the same
name and type but different encoding/compression, they will be deduplicated
by keeping only one schema entry.

Changes:
- Add updateDevice2TimeSeries method in LoadTsFileTreeSchemaCache to support
  updating the device-to-timeseries mapping
- Modify makeSureNoDuplicatedMeasurementsInDevices in TreeSchemaAutoCreatorAndVerifier
  to allow same measurement with different encoding/compression by deduplicating
  instead of throwing an exception
- Only throw exception when duplicate measurements have different data types
@jt2594838 jt2594838 merged commit 13513ea into apache:master Feb 4, 2026
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants