Package org.apache.parquet.format
Class ColumnChunk
- java.lang.Object
-
- org.apache.parquet.format.ColumnChunk
-
- All Implemented Interfaces:
Serializable,Cloneable,Comparable<ColumnChunk>,org.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>,org.apache.thrift.TSerializable
@Generated(value="Autogenerated by Thrift Compiler (0.22.0)", date="2025-12-22") public class ColumnChunk extends Object implements org.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>, Serializable, Cloneable, Comparable<ColumnChunk>- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classColumnChunk._FieldsThe set of fields this struct contains, along with convenience methods for finding and manipulating them.
-
Field Summary
Fields Modifier and Type Field Description intcolumn_index_lengthSize of ColumnChunk's ColumnIndex, in bytes *longcolumn_index_offsetFile offset of ColumnChunk's ColumnIndex *ColumnCryptoMetaDatacrypto_metadataCrypto metadata of encrypted columns *ByteBufferencrypted_column_metadataEncrypted column metadata for this chunk *longfile_offsetDeprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk.Stringfile_pathFile where column data is stored.ColumnMetaDatameta_dataColumn metadata for this chunk.static Map<ColumnChunk._Fields,org.apache.thrift.meta_data.FieldMetaData>metaDataMapintoffset_index_lengthSize of ColumnChunk's OffsetIndex, in bytes *longoffset_index_offsetFile offset of ColumnChunk's OffsetIndex *
-
Constructor Summary
Constructors Constructor Description ColumnChunk()ColumnChunk(long file_offset)ColumnChunk(ColumnChunk other)Performs a deep copy on other.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description ByteBufferbufferForEncrypted_column_metadata()voidclear()intcompareTo(ColumnChunk other)ColumnChunkdeepCopy()booleanequals(Object that)booleanequals(ColumnChunk that)ColumnChunk._FieldsfieldForId(int fieldId)intgetColumn_index_length()Size of ColumnChunk's ColumnIndex, in bytes *longgetColumn_index_offset()File offset of ColumnChunk's ColumnIndex *ColumnCryptoMetaDatagetCrypto_metadata()Crypto metadata of encrypted columns *byte[]getEncrypted_column_metadata()Encrypted column metadata for this chunk *ObjectgetFieldValue(ColumnChunk._Fields field)longgetFile_offset()Deprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk.StringgetFile_path()File where column data is stored.ColumnMetaDatagetMeta_data()Column metadata for this chunk.intgetOffset_index_length()Size of ColumnChunk's OffsetIndex, in bytes *longgetOffset_index_offset()File offset of ColumnChunk's OffsetIndex *inthashCode()booleanisSet(ColumnChunk._Fields field)Returns true if field corresponding to fieldID is set (has been assigned a value) and false otherwisebooleanisSetColumn_index_length()Returns true if field column_index_length is set (has been assigned a value) and false otherwisebooleanisSetColumn_index_offset()Returns true if field column_index_offset is set (has been assigned a value) and false otherwisebooleanisSetCrypto_metadata()Returns true if field crypto_metadata is set (has been assigned a value) and false otherwisebooleanisSetEncrypted_column_metadata()Returns true if field encrypted_column_metadata is set (has been assigned a value) and false otherwisebooleanisSetFile_offset()Returns true if field file_offset is set (has been assigned a value) and false otherwisebooleanisSetFile_path()Returns true if field file_path is set (has been assigned a value) and false otherwisebooleanisSetMeta_data()Returns true if field meta_data is set (has been assigned a value) and false otherwisebooleanisSetOffset_index_length()Returns true if field offset_index_length is set (has been assigned a value) and false otherwisebooleanisSetOffset_index_offset()Returns true if field offset_index_offset is set (has been assigned a value) and false otherwisevoidread(org.apache.thrift.protocol.TProtocol iprot)ColumnChunksetColumn_index_length(int column_index_length)Size of ColumnChunk's ColumnIndex, in bytes *voidsetColumn_index_lengthIsSet(boolean value)ColumnChunksetColumn_index_offset(long column_index_offset)File offset of ColumnChunk's ColumnIndex *voidsetColumn_index_offsetIsSet(boolean value)ColumnChunksetCrypto_metadata(ColumnCryptoMetaData crypto_metadata)Crypto metadata of encrypted columns *voidsetCrypto_metadataIsSet(boolean value)ColumnChunksetEncrypted_column_metadata(byte[] encrypted_column_metadata)Encrypted column metadata for this chunk *ColumnChunksetEncrypted_column_metadata(ByteBuffer encrypted_column_metadata)voidsetEncrypted_column_metadataIsSet(boolean value)voidsetFieldValue(ColumnChunk._Fields field, Object value)ColumnChunksetFile_offset(long file_offset)Deprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk.voidsetFile_offsetIsSet(boolean value)ColumnChunksetFile_path(String file_path)File where column data is stored.voidsetFile_pathIsSet(boolean value)ColumnChunksetMeta_data(ColumnMetaData meta_data)Column metadata for this chunk.voidsetMeta_dataIsSet(boolean value)ColumnChunksetOffset_index_length(int offset_index_length)Size of ColumnChunk's OffsetIndex, in bytes *voidsetOffset_index_lengthIsSet(boolean value)ColumnChunksetOffset_index_offset(long offset_index_offset)File offset of ColumnChunk's OffsetIndex *voidsetOffset_index_offsetIsSet(boolean value)StringtoString()voidunsetColumn_index_length()voidunsetColumn_index_offset()voidunsetCrypto_metadata()voidunsetEncrypted_column_metadata()voidunsetFile_offset()voidunsetFile_path()voidunsetMeta_data()voidunsetOffset_index_length()voidunsetOffset_index_offset()voidvalidate()voidwrite(org.apache.thrift.protocol.TProtocol oprot)
-
-
-
Field Detail
-
file_path
public String file_path
File where column data is stored. If not set, assumed to be same file as metadata. This path is relative to the current file.
-
file_offset
public long file_offset
Deprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk. In many cases, the ColumnMetaData at this location is wrong. This field is now deprecated and should not be used. Writers should set this field to 0 if no ColumnMetaData has been written outside the footer.
-
meta_data
public ColumnMetaData meta_data
Column metadata for this chunk. Some writers may also replicate this at the location pointed to by file_path/file_offset. Note: while marked as optional, this field is in fact required by most major Parquet implementations. As such, writers MUST populate this field.
-
offset_index_offset
public long offset_index_offset
File offset of ColumnChunk's OffsetIndex *
-
offset_index_length
public int offset_index_length
Size of ColumnChunk's OffsetIndex, in bytes *
-
column_index_offset
public long column_index_offset
File offset of ColumnChunk's ColumnIndex *
-
column_index_length
public int column_index_length
Size of ColumnChunk's ColumnIndex, in bytes *
-
crypto_metadata
public ColumnCryptoMetaData crypto_metadata
Crypto metadata of encrypted columns *
-
encrypted_column_metadata
public ByteBuffer encrypted_column_metadata
Encrypted column metadata for this chunk *
-
metaDataMap
public static final Map<ColumnChunk._Fields,org.apache.thrift.meta_data.FieldMetaData> metaDataMap
-
-
Constructor Detail
-
ColumnChunk
public ColumnChunk()
-
ColumnChunk
public ColumnChunk(long file_offset)
-
ColumnChunk
public ColumnChunk(ColumnChunk other)
Performs a deep copy on other.
-
-
Method Detail
-
deepCopy
public ColumnChunk deepCopy()
- Specified by:
deepCopyin interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
clear
public void clear()
- Specified by:
clearin interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
getFile_path
public String getFile_path()
File where column data is stored. If not set, assumed to be same file as metadata. This path is relative to the current file.
-
setFile_path
public ColumnChunk setFile_path(String file_path)
File where column data is stored. If not set, assumed to be same file as metadata. This path is relative to the current file.
-
unsetFile_path
public void unsetFile_path()
-
isSetFile_path
public boolean isSetFile_path()
Returns true if field file_path is set (has been assigned a value) and false otherwise
-
setFile_pathIsSet
public void setFile_pathIsSet(boolean value)
-
getFile_offset
public long getFile_offset()
Deprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk. In many cases, the ColumnMetaData at this location is wrong. This field is now deprecated and should not be used. Writers should set this field to 0 if no ColumnMetaData has been written outside the footer.
-
setFile_offset
public ColumnChunk setFile_offset(long file_offset)
Deprecated: Byte offset in file_path to the ColumnMetaData Past use of this field has been inconsistent, with some implementations using it to point to the ColumnMetaData and some using it to point to the first page in the column chunk. In many cases, the ColumnMetaData at this location is wrong. This field is now deprecated and should not be used. Writers should set this field to 0 if no ColumnMetaData has been written outside the footer.
-
unsetFile_offset
public void unsetFile_offset()
-
isSetFile_offset
public boolean isSetFile_offset()
Returns true if field file_offset is set (has been assigned a value) and false otherwise
-
setFile_offsetIsSet
public void setFile_offsetIsSet(boolean value)
-
getMeta_data
public ColumnMetaData getMeta_data()
Column metadata for this chunk. Some writers may also replicate this at the location pointed to by file_path/file_offset. Note: while marked as optional, this field is in fact required by most major Parquet implementations. As such, writers MUST populate this field.
-
setMeta_data
public ColumnChunk setMeta_data(ColumnMetaData meta_data)
Column metadata for this chunk. Some writers may also replicate this at the location pointed to by file_path/file_offset. Note: while marked as optional, this field is in fact required by most major Parquet implementations. As such, writers MUST populate this field.
-
unsetMeta_data
public void unsetMeta_data()
-
isSetMeta_data
public boolean isSetMeta_data()
Returns true if field meta_data is set (has been assigned a value) and false otherwise
-
setMeta_dataIsSet
public void setMeta_dataIsSet(boolean value)
-
getOffset_index_offset
public long getOffset_index_offset()
File offset of ColumnChunk's OffsetIndex *
-
setOffset_index_offset
public ColumnChunk setOffset_index_offset(long offset_index_offset)
File offset of ColumnChunk's OffsetIndex *
-
unsetOffset_index_offset
public void unsetOffset_index_offset()
-
isSetOffset_index_offset
public boolean isSetOffset_index_offset()
Returns true if field offset_index_offset is set (has been assigned a value) and false otherwise
-
setOffset_index_offsetIsSet
public void setOffset_index_offsetIsSet(boolean value)
-
getOffset_index_length
public int getOffset_index_length()
Size of ColumnChunk's OffsetIndex, in bytes *
-
setOffset_index_length
public ColumnChunk setOffset_index_length(int offset_index_length)
Size of ColumnChunk's OffsetIndex, in bytes *
-
unsetOffset_index_length
public void unsetOffset_index_length()
-
isSetOffset_index_length
public boolean isSetOffset_index_length()
Returns true if field offset_index_length is set (has been assigned a value) and false otherwise
-
setOffset_index_lengthIsSet
public void setOffset_index_lengthIsSet(boolean value)
-
getColumn_index_offset
public long getColumn_index_offset()
File offset of ColumnChunk's ColumnIndex *
-
setColumn_index_offset
public ColumnChunk setColumn_index_offset(long column_index_offset)
File offset of ColumnChunk's ColumnIndex *
-
unsetColumn_index_offset
public void unsetColumn_index_offset()
-
isSetColumn_index_offset
public boolean isSetColumn_index_offset()
Returns true if field column_index_offset is set (has been assigned a value) and false otherwise
-
setColumn_index_offsetIsSet
public void setColumn_index_offsetIsSet(boolean value)
-
getColumn_index_length
public int getColumn_index_length()
Size of ColumnChunk's ColumnIndex, in bytes *
-
setColumn_index_length
public ColumnChunk setColumn_index_length(int column_index_length)
Size of ColumnChunk's ColumnIndex, in bytes *
-
unsetColumn_index_length
public void unsetColumn_index_length()
-
isSetColumn_index_length
public boolean isSetColumn_index_length()
Returns true if field column_index_length is set (has been assigned a value) and false otherwise
-
setColumn_index_lengthIsSet
public void setColumn_index_lengthIsSet(boolean value)
-
getCrypto_metadata
public ColumnCryptoMetaData getCrypto_metadata()
Crypto metadata of encrypted columns *
-
setCrypto_metadata
public ColumnChunk setCrypto_metadata(ColumnCryptoMetaData crypto_metadata)
Crypto metadata of encrypted columns *
-
unsetCrypto_metadata
public void unsetCrypto_metadata()
-
isSetCrypto_metadata
public boolean isSetCrypto_metadata()
Returns true if field crypto_metadata is set (has been assigned a value) and false otherwise
-
setCrypto_metadataIsSet
public void setCrypto_metadataIsSet(boolean value)
-
getEncrypted_column_metadata
public byte[] getEncrypted_column_metadata()
Encrypted column metadata for this chunk *
-
bufferForEncrypted_column_metadata
public ByteBuffer bufferForEncrypted_column_metadata()
-
setEncrypted_column_metadata
public ColumnChunk setEncrypted_column_metadata(byte[] encrypted_column_metadata)
Encrypted column metadata for this chunk *
-
setEncrypted_column_metadata
public ColumnChunk setEncrypted_column_metadata(ByteBuffer encrypted_column_metadata)
-
unsetEncrypted_column_metadata
public void unsetEncrypted_column_metadata()
-
isSetEncrypted_column_metadata
public boolean isSetEncrypted_column_metadata()
Returns true if field encrypted_column_metadata is set (has been assigned a value) and false otherwise
-
setEncrypted_column_metadataIsSet
public void setEncrypted_column_metadataIsSet(boolean value)
-
setFieldValue
public void setFieldValue(ColumnChunk._Fields field, Object value)
- Specified by:
setFieldValuein interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
getFieldValue
public Object getFieldValue(ColumnChunk._Fields field)
- Specified by:
getFieldValuein interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
isSet
public boolean isSet(ColumnChunk._Fields field)
Returns true if field corresponding to fieldID is set (has been assigned a value) and false otherwise- Specified by:
isSetin interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
equals
public boolean equals(ColumnChunk that)
-
compareTo
public int compareTo(ColumnChunk other)
- Specified by:
compareToin interfaceComparable<ColumnChunk>
-
fieldForId
public ColumnChunk._Fields fieldForId(int fieldId)
- Specified by:
fieldForIdin interfaceorg.apache.thrift.TBase<ColumnChunk,ColumnChunk._Fields>
-
read
public void read(org.apache.thrift.protocol.TProtocol iprot) throws org.apache.thrift.TException- Specified by:
readin interfaceorg.apache.thrift.TSerializable- Throws:
org.apache.thrift.TException
-
write
public void write(org.apache.thrift.protocol.TProtocol oprot) throws org.apache.thrift.TException- Specified by:
writein interfaceorg.apache.thrift.TSerializable- Throws:
org.apache.thrift.TException
-
validate
public void validate() throws org.apache.thrift.TException- Throws:
org.apache.thrift.TException
-
-