hyped.core.nodes package

Submodules

• hyped.core.nodes.aggregator module
  • BaseDataAggregator
    • BaseDataAggregator.Extracted
    • BaseDataAggregator.State
    • BaseDataAggregator.Value
    • BaseDataAggregator.extract()
    • BaseDataAggregator.seed()
    • BaseDataAggregator.signature
    • BaseDataAggregator.update()
  • BaseDataAggregatorConfig
    • BaseDataAggregatorConfig.model_config
  • DataAggregationManager
    • DataAggregationManager.aggregate()
    • DataAggregationManager.values_proxy
• hyped.core.nodes.augmentor module
  • BaseDataAugmentor
    • BaseDataAugmentor.infer_output_partition()
    • BaseDataAugmentor.process()
    • BaseDataAugmentor.run()
    • BaseDataAugmentor.signature
  • BaseDataAugmentorConfig
    • BaseDataAugmentorConfig.model_config
• hyped.core.nodes.base module
  • BaseNode
    • BaseNode.Config
    • BaseNode.call()
    • BaseNode.get_state()
    • BaseNode.initialize()
    • BaseNode.set_state()
    • BaseNode.signature
    • BaseNode.with_state()
  • BaseNodeConfig
    • BaseNodeConfig.model_config
  • NodeProtocol
    • NodeProtocol.call()
  • ProcessMode
    • ProcessMode.F
    • ProcessMode.backend
    • ProcessMode.batched
    • ProcessMode.decorate()
    • ProcessMode.finalize()
    • ProcessMode.from_arrow_converters
    • ProcessMode.from_decorated_fn()
    • ProcessMode.prepare()
    • ProcessMode.register_from_arrow_converter()
    • ProcessMode.register_to_arrow_converter()
    • ProcessMode.set_default()
    • ProcessMode.to_arrow_converters
    • ProcessMode.validate()
  • RunContext
    • RunContext.index
    • RunContext.input_dtype
    • RunContext.node_id
    • RunContext.output_dtype
    • RunContext.rank
    • RunContext.session
    • RunContext.target_batch_size
  • RunSession
    • RunSession.get_context()
    • RunSession.session_id
    • RunSession.set_context()
  • process_mode()
• hyped.core.nodes.collect module
  • CollectNode
    • CollectNode.build_output_type()
    • CollectNode.call()
    • CollectNode.collect()
    • CollectNode.signature
  • CollectNodeConfig
    • CollectNodeConfig.lookup
    • CollectNodeConfig.model_config
• hyped.core.nodes.const module
  • ConstNode
    • ConstNode.call()
    • ConstNode.signature
  • ConstNodeConfig
    • ConstNodeConfig.model_config
    • ConstNodeConfig.value
• hyped.core.nodes.debug module
  • BaseDebugNode
    • BaseDebugNode.call()
    • BaseDebugNode.process()
    • BaseDebugNode.run()
  • BaseDebugNodeConfig
    • BaseDebugNodeConfig.model_config
• hyped.core.nodes.processor module
  • BaseDataProcessor
    • BaseDataProcessor.process()
    • BaseDataProcessor.run()
    • BaseDataProcessor.signature
  • BaseDataProcessorConfig
    • BaseDataProcessorConfig.model_config
• hyped.core.nodes.trace module
  • TraceNode
    • TraceNode.call()
    • TraceNode.signature
    • TraceNode.trace_values_through_partition_path()
  • TraceNodeConfig
    • TraceNodeConfig.model_config
    • TraceNodeConfig.path

Module contents

The nodes sub-module defines abstract base classes for data processing nodes.

This sub-module includes the base classes for various types of nodes used in the data flow graph, such as aggregators and processors. These classes provide the foundation for implementing specific data processing tasks. Each node type requires implementation of certain methods to define their behavior within the data flow.