SparkCraft
latest

User Guide

  • Usage
  • Contributor Guide
  • Code of Conduct
  • License
  • Changelog

API Reference

  • utils
  • joins
  • partitions
SparkCraft
  • Index
  • Edit on GitHub

Index

A | D | G | M | O | R | S

A

  • add_partition_id_col() (in module sparkcraft.partitions)
  • add_salt_column() (in module sparkcraft.joins)

D

  • df_size_in_bytes_approximate() (in module sparkcraft.utils.size_estimation)
  • df_size_in_bytes_exact() (in module sparkcraft.utils.size_estimation)

G

  • get_log4j_logger() (in module sparkcraft.utils.session)
  • get_optimal_number_of_partitions() (in module sparkcraft.partitions)
  • get_partition_count_df() (in module sparkcraft.partitions)
  • get_partition_count_distribution() (in module sparkcraft.partitions)
  • get_spark_session() (in module sparkcraft.utils.session)

M

  • module
    • sparkcraft.joins
    • sparkcraft.partitions
    • sparkcraft.utils.session
    • sparkcraft.utils.size_estimation

O

  • optimal_cross_join() (in module sparkcraft.joins)

R

  • remove_empty_partitions() (in module sparkcraft.partitions)

S

  • sparkcraft.joins
    • module
  • sparkcraft.partitions
    • module
  • sparkcraft.utils.session
    • module
  • sparkcraft.utils.size_estimation
    • module

© Copyright 2023, Miguel Otero Pedrido. Revision 40e3e2d1.

Built with Sphinx using a theme provided by Read the Docs.