Skip to main content
Physics LibreTexts

1.4: General Aspects of Probability Distributions

  • Page ID
    18544
  • \( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \) \( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)\(\newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\) \( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\) \( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\) \( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\) \( \newcommand{\Span}{\mathrm{span}}\) \(\newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\) \( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\) \( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\) \( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\) \( \newcommand{\Span}{\mathrm{span}}\)\(\newcommand{\AA}{\unicode[.8,0]{x212B}}\)

    \( \newcommand\bes{\begin{equation}\begin{split}}\)
    \( \newcommand\ltwid{\propto}\)
    \( \newcommand\ees{\end{split}\end{equation}}\)
    \( \newcommand\mib{\mathbf}\)
    \( \newcommand\Sa{\textsf a}\)
    \( \newcommand\Sb{\textsf b}\)
    \( \newcommand\Sc{\textsf c}\)
    \( \newcommand\Sd{\textsf d}\)
    \( \newcommand\Se{\textsf e}\)
    \( \newcommand\Sf{\textsf f}\)
    \( \newcommand\Sg{\textsf g}\)
    \( \newcommand\Sh{\textsf h}\)
    \( \newcommand\Si{\textsf i}\)
    \( \newcommand\Sj{\textsf j}\)
    \( \newcommand\Sk{\textsf k}\)
    \( \newcommand\Sl{\textsf l}\)
    \( \newcommand\Sm{\textsf m}\)
    \( \newcommand\Sn{\textsf n}\)
    \( \newcommand\So{\textsf o}\)
    \( \newcommand\Sp{\textsf p}\)
    \( \newcommand\Sq{\textsf q}\)
    \( \newcommand\Sr{\textsf r}\)
    \( \newcommand\Ss{\textsf s}\)
    \( \newcommand\St{\textsf t}\)
    \( \newcommand\Su{\textsf u}\)
    \( \newcommand\Sv{\textsf v}\)
    \( \newcommand\Sw{\textsf w}\)
    \( \newcommand\Sx{\textsf x}\)
    \( \newcommand\Sy{\textsf y}\)
    \( \newcommand\Sz{\textsf z}\)
    \( \newcommand\SA{\textsf A}\)
    \( \newcommand\SB{\textsf B}\)
    \( \newcommand\SC{\textsf C}\)
    \( \newcommand\SD{\textsf D}\)
    \( \newcommand\SE{\textsf E}\)
    \( \newcommand\SF{\textsf F}\)
    \( \newcommand\SG{\textsf G}\)
    \( \newcommand\SH{\textsf H}\)
    \( \newcommand\SI{\textsf I}\)
    \( \newcommand\SJ{\textsf J}\)
    \( \newcommand\SK{\textsf K}\)
    \( \newcommand\SL{\textsf L}\)
    \( \newcommand\SM{\textsf M}\)
    \( \newcommand\SN{\textsf N}\)
    \( \newcommand\SO{\textsf O}\)
    \( \newcommand\SP{\textsf P}\)
    \( \newcommand\SQ{\textsf Q}\)
    \( \newcommand\SR{\textsf R}\)
    \( \newcommand\SS{\textsf S}\)
    \( \newcommand\ST{\textsf T}\)
    \( \newcommand\SU{\textsf U}\)
    \( \newcommand\SV{\textsf V}\)
    \( \newcommand\SW{\textsf W}\)
    \( \newcommand\SX{\textsf X}\)
    \( \newcommand\SY{\textsf Y}\)
    \( \newcommand\SZ{\textsf Z}\)
    \( \newcommand\Ha{\hat a}\)
    \( \newcommand\Hb{\hat b}\)
    \( \newcommand\Hc{\hat c}\)
    \( \newcommand\Hd{\hat d}\)
    \( \newcommand\He{\hat e}\)
    \( \newcommand\Hf{\hat f}\)
    \( \newcommand\Hg{\hat g}\)
    \( \newcommand\Hh{\hat h}\)
    \( \newcommand\Hi{\hat \imath}\)
    \( \newcommand\Hj{\hat \jmath}\)
    \( \newcommand\Hk{\hat k}\)
    \( \newcommand\Hl{\hat l}\)
    \( \newcommand\Hm{\hat m}\)
    \( \newcommand\Hn{\hat n}\)
    \( \newcommand\Ho{\hat o}\)
    \( \newcommand\Hp{\hat p}\)
    \( \newcommand\Hq{\hat q}\)
    \( \newcommand\Hr{\hat r}\)
    \( \newcommand\Hs{\hat s}\)
    \( \newcommand\Ht{\hat t}\)
    \( \newcommand\Hu{\hat u}\)
    \( \newcommand\Hv{\hat v}\)
    \( \newcommand\Hw{\hat w}\)
    \( \newcommand\Hx{\hat x}\)
    \( \newcommand\Hy{\hat y}\)
    \( \newcommand\Hz{\hat z}\)
    \( \newcommand\HA{\hat A}\)
    \( \newcommand\HB{\hat B}\)
    \( \newcommand\HC{\hat C}\)
    \( \newcommand\HD{\hat D}\)
    \( \newcommand\HE{\hat E}\)
    \( \newcommand\HF{\hat F}\)
    \( \newcommand\HG{\hat G}\)
    \( \newcommand\HH{\hat H}\)
    \( \newcommand\HI{\hat I}\)
    \( \newcommand\HJ{\hat J}\)
    \( \newcommand\HK{\hat K}\)
    \( \newcommand\HL{\hat L}\)
    \( \newcommand\HM{\hat M}\)
    \( \newcommand\HN{\hat N}\)
    \( \newcommand\HO{\hat O}\)
    \( \newcommand\HP{\hat P}\)
    \( \newcommand\HQ{\hat Q}\)
    \( \newcommand\HR{\hat R}\)
    \( \newcommand\HS{\hat S}\)
    \( \newcommand\HT{\hat T}\)
    \( \newcommand\HU{\hat U}\)
    \( \newcommand\HV{\hat V}\)
    \( \newcommand\HW{\hat W}\)
    \( \newcommand\HX{\hat X}\)
    \( \newcommand\HY{\hat Y}\)
    \( \newcommand\HZ{\hat Z}\)
    \( \newcommand\Halpha{\hat\alpha}\)
    \( \newcommand\Hbeta{\hat\beta}\)
    \( \newcommand\Hgamma{\hat\gamma}\)
    \( \newcommand\Hdelta{\hat\delta}\)
    \( \newcommand\Hepsilon{\hat\epsilon}\)
    \( \newcommand\Hvarepsilon{\hat\varepsilon}\)
    \( \newcommand\Hzeta{\hat\zeta}\)
    \( \newcommand\Heta{\hat\eta}\)
    \( \newcommand\Htheta{\hat\theta}\)
    \( \newcommand\Hvartheta{\hat\vartheta}\)
    \( \newcommand\Hiota{\hat\iota}\)
    \( \newcommand\Hkappa{\hat\kappa}\)
    \( \newcommand\Hlambda{\hat\lambda}\)
    \( \newcommand\Hmu{\hat\mu}\)
    \( \newcommand\Hnu{\hat\nu}\)
    \( \newcommand\Hxi{\hat\xi}\)
    \( \newcommand\Hom{\hat\omicron}\)
    \( \newcommand\Hpi{\hat\pi}\)
    \( \newcommand\Hvarpi{\hat\varpi}\)
    \( \newcommand\Hrho{\hat\rho}\)
    \( \newcommand\Hvarrho{\hat\varrho}\)
    \( \newcommand\Hsigma{\hat\sigma}\)
    \( \newcommand\Hvarsigma{\hat\varsigma}\)
    \( \newcommand\Htau{\var\tau}\)
    \( \newcommand\Hupsilon{\hat\upsilon}\)
    \( \newcommand\Hphi{\hat\phi}\)
    \( \newcommand\Hvarphi{\hat\varphi}\)
    \( \newcommand\Hchi{\hat\chi}\)
    \( \newcommand\Hxhi{\hat\xhi}\)
    \( \newcommand\Hpsi{\hat\psi}\)
    \( \newcommand\Homega{\hat\omega}\)
    \( \newcommand\HGamma{\hat\Gamma}\)
    \( \newcommand\HDelta{\hat\Delta}\)
    \( \newcommand\HTheta{\hat\Theta}\)
    \( \newcommand\HLambda{\hat\Lambda}\)
    \( \newcommand\HXi{\hat\Xi}\)
    \( \newcommand\HPi{\hat\Pi}\)
    \( \newcommand\HSigma{\hat\Sigma}\)
    \( \newcommand\HUps{\hat\Upsilon}\)
    \( \newcommand\HPhi{\hat\Phi}\)
    \( \newcommand\HPsi{\hat\Psi}\)
    \( \newcommand\HOmega{\hat\Omega}\)
    \( \newcommand\xhat{\hat\Bx}\)
    \( \newcommand\yhat{\hat\By}\)
    \( \newcommand\zhat{\hat\Bz}\)
    \( \newcommand\ehat{\hat\Be}\)
    \( \newcommand\khat{\hat\Bk}\)
    \( \newcommand\nhat{\hat\Bn}\)
    \( \newcommand\rhat{\hat\Br}\)
    \( \newcommand\phihat{\hat\Bphi}\)
    \( \newcommand\thetahat{\hat\Btheta}\)
    \( \newcommand\MA{\mathbb A}\)
    \( \newcommand\MB{\mathbb B}\)
    \( \newcommand\MC{\mathbb C}\)
    \( \newcommand\MD{\mathbb D}\)
    \( \newcommand\ME{\mathbb E}\)
    \( \newcommand\MF{\mathbb F}\)
    \( \newcommand\MG{\mathbb G}\)
    \( \newcommand\MH{\mathbb H}\)
    \( \newcommand\MI{\mathbb I}\)
    \( \newcommand\MJ{\mathbb J}\)
    \( \newcommand\MK{\mathbb K}\)
    \( \newcommand\ML{\mathbb L}\)
    \( \newcommand\MM{\mathbb M}\)
    \( \newcommand\MN{\mathbb N}\)
    \( \newcommand\MO{\mathbb O}\)
    \( \newcommand\MP{\mathbb P}\)
    \( \newcommand\MQ{\mathbb Q}\)
    \( \newcommand\MR{\mathbb R}\)
    \( \newcommand\MS{\mathbb S}\)
    \( \newcommand\MT{\mathbb T}\)
    \( \newcommand\MU{\mathbb U}\)
    \( \newcommand\MV{\mathbb V}\)
    \( \newcommand\MW{\mathbb W}\)
    \( \newcommand\MX{\mathbb X}\)
    \( \newcommand\MY{\mathbb Y}\)
    \( \newcommand\MZ{\mathbb Z}\)
    \( \newcommand\CA{\mathcal A}\)
    \( \newcommand\CB{\mathcal B}\)
    \( \newcommand\CC{\mathcal C}\)
    \( \newcommand\CD{\mathcal D}\)
    \( \newcommand\CE{\mathcal E}\)
    \( \newcommand\CF{\mathcal F}\)
    \( \newcommand\CG{\mathcal G}\)
    \( \newcommand\CH{\mathcal H}\)
    \( \newcommand\CI{\mathcal I}\)
    \( \newcommand\CJ{\mathcal J}\)
    \( \newcommand\CK{\mathcal K}\)
    \( \newcommand\CL{\mathcal L}\)
    \( \newcommand\CM{\mathcal M}\)
    \( \newcommand\CN{\mathcal N}\)
    \( \newcommand\CO{\mathcal O}\)
    \( \newcommand\CP{\mathcal P}\)
    \( \newcommand\CQ{\mathcal Q}\)
    \( \newcommand\CR{\mathcal R}\)
    \( \newcommand\CS{\mathcal S}\)
    \( \newcommand\CT{\mathcal T}\)
    \( \newcommand\CU{\mathcal U}\)
    \( \newcommand\CV{\mathcal V}\)
    \( \newcommand\CW{\mathcal W}\)
    \( \newcommand\CX{\mathcal X}\)
    \( \newcommand\CY{\mathcal Y}\)
    \( \newcommand\CZ{\mathcal Z}\)
    \( \newcommand\Fa{\mathfrak a}\)
    \( \newcommand\Fb{\mathfrak b}\)
    \( \newcommand\Fc{\mathfrak c}\)
    \( \newcommand\Fd{\mathfrak d}\)
    \( \newcommand\Fe{\mathfrak e}\)
    \( \newcommand\Ff{\mathfrak f}\)
    \( \newcommand\Fg{\mathfrak g}\)
    \( \newcommand\Fh{\mathfrak h}\)
    \( \newcommand\Fi{\mathfrak i}\)
    \( \newcommand\Fj{\mathfrak j}\)
    \( \newcommand\Fk{\mathfrak k}\)
    \( \newcommand\Fl{\mathfrak l}\)
    \( \newcommand\Fm{\mathfrak m}\)
    \( \newcommand\Fn{\mathfrak n}\)
    \( \newcommand\Fo{\mathfrak o}\)
    \( \newcommand\Fp{\mathfrak p}\)
    \( \newcommand\Fq{\mathfrak q}\)
    \( \newcommand\Fr{\mathfrak r}\)
    \( \newcommand\Fs{\mathfrak s}\)
    \( \newcommand\Ft{\mathfrak t}\)
    \( \newcommand\Fu{\mathfrak u}\)
    \( \newcommand\Fv{\mathfrak v}\)
    \( \newcommand\Fw{\mathfrak w}\)
    \( \newcommand\Fx{\mathfrak x}\)
    \( \newcommand\Fy{\mathfrak y}\)
    \( \newcommand\Fz{\mathfrak z}\)
    \( \newcommand\FA{\mathfrak A}\)
    \( \newcommand\FB{\mathfrak B}\)
    \( \newcommand\FC{\mathfrak C}\)
    \( \newcommand\FD{\mathfrak D}\)
    \( \newcommand\FE{\mathfrak E}\)
    \( \newcommand\FF{\mathfrak F}\)
    \( \newcommand\FG{\mathfrak G}\)
    \( \newcommand\FH{\mathfrak H}\)
    \( \newcommand\FI{\mathfrak I}\)
    \( \newcommand\FJ{\mathfrak J}\)
    \( \newcommand\FK{\mathfrak K}\)
    \( \newcommand\FL{\mathfrak L}\)
    \( \newcommand\FM{\mathfrak M}\)
    \( \newcommand\FN{\mathfrak N}\)
    \( \newcommand\FO{\mathfrak O}\)
    \( \newcommand\FP{\mathfrak P}\)
    \( \newcommand\FQ{\mathfrak Q}\)
    \( \newcommand\FR{\mathfrak R}\)
    \( \newcommand\FS{\mathfrak S}\)
    \( \newcommand\FT{\mathfrak T}\)
    \( \newcommand\FU{\mathfrak U}\)
    \( \newcommand\FV{\mathfrak V}\)
    \( \newcommand\FW{\mathfrak W}\)
    \( \newcommand\FX{\mathfrak X}\)
    \( \newcommand\FY{\mathfrak Y}\)
    \( \newcommand\FZ{\mathfrak Z}\)
    \( \newcommand\Da{\dot a}\)
    \( \newcommand\Db{\dot b}\)
    \( \newcommand\Dc{\dot c}\)
    \( \newcommand\Dd{\dot d}\)
    \( \newcommand\De{\dot e}\)
    \( \newcommand\Df{\dot f}\)
    \( \newcommand\Dg{\dot g}\)
    \( \newcommand\Dh{\dot h}\)
    \( \newcommand\Di{\dot \imath}\)
    \( \newcommand\Dj{\dot \jmath}\)
    \( \newcommand\Dk{\dot k}\)
    \( \newcommand\Dl{\dot l}\)
    \( \newcommand\Dm{\dot m}\)
    \( \newcommand\Dn{\dot n}\)
    \( \newcommand\Do{\dot o}\)
    \( \newcommand\Dp{\dot p}\)
    \( \newcommand\Dq{\dot q}\)
    \( \newcommand\Dr{\dot r}\)
    \( \newcommand\Ds{\dot s}\)
    \( \newcommand\Dt{\dot t}\)
    \( \newcommand\Du{\dot u}\)
    \( \newcommand\Dv{\dot v}\)
    \( \newcommand\Dw{\dot w}\)
    \( \newcommand\Dx{\dot x}\)
    \( \newcommand\Dy{\dot y}\)
    \( \newcommand\Dz{\dot z}\)
    \( \newcommand\DA{\dot A}\)
    \( \newcommand\DB{\dot B}\)
    \( \newcommand\DC{\dot C}\)
    \( \newcommand\DD{\dot D}\)
    \( \newcommand\DE{\dot E}\)
    \( \newcommand\DF{\dot F}\)
    \( \newcommand\DG{\dot G}\)
    \( \newcommand\DH{\dot H}\)
    \( \newcommand\DI{\dot I}\)
    \( \newcommand\DJ{\dot J}\)
    \( \newcommand\DK{\dot K}\)
    \( \newcommand\DL{\dot L}\)
    \( \newcommand\DM{\dot M}\)
    \( \newcommand\DN{\dot N}\)
    \( \newcommand\DO{\dot O}\)
    \( \newcommand\DP{\dot P}\)
    \( \newcommand\DQ{\dot Q}\)
    \( \newcommand\DR{\dot R}\)
    \( \newcommand\DS{\dot S}\)
    \( \newcommand\DT{\dot T}\)
    \( \newcommand\DU{\dot U}\)
    \( \newcommand\DV{\dot V}\)
    \( \newcommand\DW{\dot W}\)
    \( \newcommand\DX{\dot X}\)
    \( \newcommand\DY{\dot Y}\)
    \( \newcommand\DZ{\dot Z}\)
    \( \newcommand\Dalpha

    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[1], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dbeta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[2], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dgamma
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[3], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Ddelta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[4], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Depsilon
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[5], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dvarepsilon
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[6], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dzeta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[7], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Deta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[8], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dtheta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[9], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dvartheta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[10], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Diota
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[11], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dkappa
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[12], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dlambda
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[13], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Dmu{\dot\mu}\)
    \( \newcommand\Dnu{\dot\nu}\)
    \( \newcommand\Dxi{\dot\xi}\)
    \( \newcommand\Dom{\dot\omicron}\)
    \( \newcommand\Dpi{\dot\pi}\)
    \( \newcommand\Dvarpi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[14], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Drho{\dot\rho}\)
    \( \newcommand\Dvarrho{\dot\varrho}\)
    \( \newcommand\Dsigma{\dot\sigma}\)
    \( \newcommand\Dvarsigma{\dot\varsigma}\)
    \( \newcommand\Dtau{\var\tau}\)
    \( \newcommand\Dupsilon{\dot\upsilon}\)
    \( \newcommand\Dphi{\dot\phi}\)
    \( \newcommand\Dvarphi{\dot\varphi}\)
    \( \newcommand\Dchi{\dot\chi}\)
    \( \newcommand\Dpsi{\dot\psi}\)
    \( \newcommand\Domega{\dot\omega}\)
    \( \newcommand\DGamma
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[15], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\DDelta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[16], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\DTheta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[17], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\DLambda{\dot\Lambda}\)
    \( \newcommand\DXi{\dot\Xi}\)
    \( \newcommand\DPi{\dot\Pi}\)
    \( \newcommand\DSigma{\dot\Sigma}\)
    \( \newcommand\DUps{\dot\Upsilon}\)
    \( \newcommand\DPhi{\dot\Phi}\)
    \( \newcommand\DPsi{\dot\Psi}\)
    \( \newcommand\DOmega{\dot\Omega}\)
    \( \newcommand\Va{\vec a}\)
    \( \newcommand\Vb{\vec b}\)
    \( \newcommand\Vc{\vec c}\)
    \( \newcommand\Vd{\vec d}\)
    \( \newcommand\Ve{\vec e}\)
    \( \newcommand\Vf{\vec f}\)
    \( \newcommand\Vg{\vec g}\)
    \( \newcommand\Vh{\vec h}\)
    \( \newcommand\Vi{\vec \imath}\)
    \( \newcommand\Vj{\vec \jmath}\)
    \( \newcommand\Vk{\vec k}\)
    \( \newcommand\Vl{\vec l}\)
    \( \newcommand\Vm{\vec m}\)
    \( \newcommand\Vn{\vec n}\)
    \( \newcommand\Vo{\vec o}\)
    \( \newcommand\Vp{\vec p}\)
    \( \newcommand\Vq{\vec q}\)
    \( \newcommand\Vr{\vec r}\)
    \( \newcommand\Vs{\vec s}\)
    \( \newcommand\Vt{\vec t}\)
    \( \newcommand\Vu{\vec u}\)
    \( \newcommand\Vv{\vec v}\)
    \( \newcommand\Vw{\vec w}\)
    \( \newcommand\Vx{\vec x}\)
    \( \newcommand\Vy{\vec y}\)
    \( \newcommand\Vz{\vec z}\)
    \( \newcommand\VA{\vec A}\)
    \( \newcommand\VB{\vec B}\)
    \( \newcommand\VC{\vec C}\)
    \( \newcommand\VD{\vec D}\)
    \( \newcommand\VE{\vec E}\)
    \( \newcommand\VF{\vec F}\)
    \( \newcommand\VG{\vec G}\)
    \( \newcommand\VH{\vec H}\)
    \( \newcommand\VI{\vec I}\)
    \( \newcommand\VJ{\vec J}\)
    \( \newcommand\VK{\vec K}\)
    \( \newcommand\VL{\vec L}\)
    \( \newcommand\VM{\vec M}\)
    \( \newcommand\VN{\vec N}\)
    \( \newcommand\VO{\vec O}\)
    \( \newcommand\VP{\vec P}\)
    \( \newcommand\VQ{\vec Q}\)
    \( \newcommand\VR{\vec R}\)
    \( \newcommand\VS{\vec S}\)
    \( \newcommand\VT{\vec T}\)
    \( \newcommand\VU{\vec U}\)
    \( \newcommand\VV{\vec V}\)
    \( \newcommand\VW{\vec W}\)
    \( \newcommand\VX{\vec X}\)
    \( \newcommand\VY{\vec Y}\)
    \( \newcommand\VZ{\vec Z}\)
    \( \newcommand\Valpha{\vec\alpha}\)
    \( \newcommand\Vbeta{\vec\beta}\)
    \( \newcommand\Vgamma{\vec\gamma}\)
    \( \newcommand\Vdelta{\vec\delta}\)
    \( \newcommand\Vepsilon{\vec\epsilon}\)
    \( \newcommand\Vvarepsilon{\vec\varepsilon}\)
    \( \newcommand\Vzeta{\vec\zeta}\)
    \( \newcommand\Veta{\vec\eta}\)
    \( \newcommand\Vtheta{\vec\theta}\)
    \( \newcommand\Vvartheta{\vec\vartheta}\)
    \( \newcommand\Viota{\vec\iota}\)
    \( \newcommand\Vkappa{\vec\kappa}\)
    \( \newcommand\Vlambda{\vec\lambda}\)
    \( \newcommand\Vmu
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[18], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vnu
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[19], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vxi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[20], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vom
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[21], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vpi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[22], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vvarpi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[23], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vrho
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[24], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vvarrho
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[25], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vsigma
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[26], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vvarsigma
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[27], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vtau
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[28], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vupsilon
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[29], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vphi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[30], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vvarphi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[31], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vchi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[32], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vpsi
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[33], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\Vomega
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[34], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\VGamma
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[35], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\VDelta
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/p[1]/span[36], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\VTheta{\vec\Theta}\)
    \( \newcommand\VLambda{\vec\Lambda}\)
    \( \newcommand\VXi{\vec\Xi}\)
    \( \newcommand\VPi{\vec\Pi}\)
    \( \newcommand\VSigma{\vec\Sigma}\)
    \( \newcommand\VUps{\vec\Upsilon}\)
    \( \newcommand\VPhi{\vec\Phi}\)
    \( \newcommand\VPsi{\vec\Psi}\)
    \( \newcommand\VOmega{\vec\Omega}\)
    \( \newcommand\BA{\mib A}\)
    \( \newcommand\BB{\mib B}\)
    \( \newcommand\BC{\mib C}\)
    \( \newcommand\BD{\mib D}\)
    \( \newcommand\BE{\mib E}\)
    \( \newcommand\BF{\mib F}\)
    \( \newcommand\BG{\mib G}\)
    \( \newcommand\BH{\mib H}\)
    \( \newcommand\BI{\mib I}}\)
    \( \newcommand\BJ{\mib J}\)
    \( \newcommand\BK{\mib K}\)
    \( \newcommand\BL{\mib L}\)
    \( \newcommand\BM{\mib M}\)
    \( \newcommand\BN{\mib N}\)
    \( \newcommand\BO{\mib O}\)
    \( \newcommand\BP{\mib P}\)
    \( \newcommand\BQ{\mib Q}\)
    \( \newcommand\BR{\mib R}\)
    \( \newcommand\BS{\mib S}\)
    \( \newcommand\BT{\mib T}\)
    \( \newcommand\BU{\mib U}\)
    \( \newcommand\BV{\mib V}\)
    \( \newcommand\BW{\mib W}\)
    \( \newcommand\BX{\mib X}\)
    \( \newcommand\BY{\mib Y}\)
    \( \newcommand\BZ{\mib Z}\)
    \( \newcommand\Ba{\mib a}\)
    \( \newcommand\Bb{\mib b}\)
    \( \newcommand\Bc{\mib c}\)
    \( \newcommand\Bd{\mib d}\)
    \( \newcommand\Be{\mib e}\)
    \( \newcommand\Bf{\mib f}\)
    \( \newcommand\Bg{\mib g}\)
    \( \newcommand\Bh{\mib h}\)
    \( \newcommand\Bi{\mib i}\)
    \( \newcommand\Bj{\mib j}\)
    \( \newcommand\Bk{\mib k}\)
    \( \newcommand\Bl{\mib l}\)
    \( \newcommand\Bm{\mib m}\)
    \( \newcommand\Bn{\mib n}\)
    \( \newcommand\Bo{\mib o}\)
    \( \newcommand\Bp{\mib p}\)
    \( \newcommand\Bq{\mib q}\)
    \( \newcommand\Br{\mib r}\)
    \( \newcommand\Bs{\mib s}\)
    \( \newcommand\Bt{\mib t}\)
    \( \newcommand\Bu{\mib u}\)
    \( \newcommand\Bv{\mib v}\)
    \( \newcommand\Bw{\mib w}\)
    \( \newcommand\Bx{\mib x}\)
    \( \newcommand\By{\mib y}\)
    \( \newcommand\Bz{\mib z}\)\)
    \( \newcommand\vrh{\varrho}\)
    \( \newcommand\vsig{\varsigma}\)
    \( \newcommand\ups{\upsilon}\)
    \( \newcommand\eps{\epsilon}\)
    \( \newcommand\ve{\varepsilon}\)
    \( \newcommand\vth{\vartheta}\)
    \( \newcommand\vphi{\varphi}\)
    \( \newcommand\xhi{\chi}\)
    \( \newcommand\Ups{\Upsilon}\)
    \( \newcommand\Balpha{\mib\alpha}\)
    \( \newcommand\Bbeta{\mib\beta}\)
    \( \newcommand\Bgamma{\mib\gamma}\)
    \( \newcommand\Bdelta{\mib\delta}\)
    \( \newcommand\Beps{\mib\epsilon}\)
    \( \newcommand\Bve{\mib\varepsilon}\)
    \( \newcommand\Bzeta{\mib\zeta}\)
    \( \newcommand\Beta{\mib\eta}\)
    \( \newcommand\Btheta{\mib\theta}\)
    \( \newcommand\Bvth{\mib\vartheta}\)
    \( \newcommand\Biota{\mib\iota}\)
    \( \newcommand\Bkappa{\mib\kappa}\)
    \( \newcommand\Blambda{\mib\lambda}\)
    \( \newcommand\Bmu{\mib\mu}\)
    \( \newcommand\Bnu{\mib\nu}\)
    \( \newcommand\Bxi{\mib\xi}\)
    \( \newcommand\Bom{\mib\omicron}\)
    \( \newcommand\Bpi{\mib\pi}\)
    \( \newcommand\Bvarpi{\mib\varpi}\)
    \( \newcommand\Brho{\mib\rho}\)
    \( \newcommand\Bvrh{\mib\varrho}\)
    \( \newcommand\Bsigma{\mib\sigma}\)
    \( \newcommand\Bvsig{\mib\varsigma}\)
    \( \newcommand\Btau{\mib\tau}\)
    \( \newcommand\Bups{\mib\upsilon}\)
    \( \newcommand\Bphi{\mib\phi}\)
    \( \newcommand\Bvphi{\mib\vphi}\)
    \( \newcommand\Bchi{\mib\chi}\)
    \( \newcommand\Bpsi{\mib\psi}\)
    \( \newcommand\Bomega{\mib\omega}\)
    \( \newcommand\BGamma{\mib\Gamma}\)
    \( \newcommand\BDelta{\mib\Delta}\)
    \( \newcommand\BTheta{\mib\Theta}\)
    \( \newcommand\BLambda{\mib\Lambda}\)
    \( \newcommand\BXi{\mib\Xi}\)
    \( \newcommand\BPi{\mib\Pi}\)
    \( \newcommand\BSigma{\mib\Sigma}\)
    \( \newcommand\BUps{\mib\Upsilon}\)
    \( \newcommand\BPhi{\mib\Phi}\)
    \( \newcommand\BPsi{\mib\Psi}\)
    \( \newcommand\BOmega{\mib\Omega}\)
    \( \newcommand\Bxhi{\raise.35ex\hbox{$\Bchi$}}\)
    \( \newcommand\RGamma{ \Gamma}\)
    \( \newcommand\RDelta{ \Delta}\)
    \( \newcommand\RTheta{ \Theta}\)
    \( \newcommand\RLambda{ \Lambda}\)
    \( \newcommand\RXi{ \Xi}\)
    \( \newcommand\RPi{ \Pi}\)
    \( \newcommand\RSigma{ \Sigma}\)
    \( \newcommand\RUps{ \Upsilon}\)
    \( \newcommand\RPhi{ \Phi}\)
    \( \newcommand\RPsi{ \Psi}\)
    \( \newcommand\ROmega{ \Omega}\)
    \( \newcommand\RA{ A}\)
    \( \newcommand\RB{ B}\)
    \( \newcommand\RC{ C}\)
    \( \newcommand\RD{ D}\)
    \( \newcommand\RE{ E}\)
    \( \newcommand\RF{ F}\)
    \( \newcommand\RG{ G}\)
    \( \newcommand\RH{ H}\)
    \( \newcommand\RI{ I}\)
    \( \newcommand\RJ{ J}\)
    \( \newcommand\RK{ K}\)
    \( \newcommand\RL{ L}\)
    \( \newcommand { M}\)
    \( \newcommand\RN{ N}\)
    \( \newcommand\RO{ O}\)
    \( \newcommand\RP{ P}\)
    \( \newcommand\RQ{ Q}\)
    \( \newcommand\RR{ R}\)
    \( \newcommand\RS{ S}\)
    \( \newcommand\RT{ T}\)
    \( \newcommand\RU{ U}\)
    \( \newcommand\RV{ V}\)
    \( \newcommand\RW{ W}\)
    \( \newcommand\RX{ X}\)
    \( \newcommand\RY{ Y}\)
    \( \newcommand\RZ{ Z}\)
    \( \newcommand\Ra{ a}\)
    \( \newcommand\Rb{ b}\)
    \( \newcommand\Rc{ c}\)
    \( \newcommand\Rd{ d}\)
    \( \newcommand\Re{ e}\)
    \( \newcommand\Rf{ f}\)
    \( \newcommand\Rg{ g}\)
    \( \newcommand\Rh{ h}\)
    \( \newcommand\Ri{ i}\)
    \( \newcommand\Rj{ j}\)
    \( \newcommand\Rk{ k}\)
    \( \newcommand\Rl{ l}\)
    \( \newcommand { m}\)
    \( \newcommand\Rn{ n}\)
    \( \newcommand\Ro{ o}\)
    \( \newcommand\Rp{ p}\)
    \( \newcommand\Rq{ q}\)
    \( \newcommand\Rr{ r}\)
    \( \newcommand\Rs{ s}\)
    \( \newcommand\Rt{ t}\)
    \( \newcommand\Ru{ u}\)
    \( \newcommand\Rv{ v}\)
    \( \newcommand\Rw{ w}\)
    \( \newcommand\Rx{ x}\)
    \( \newcommand\Ry{ y}\)
    \( \newcommand\Rz{ z}\)
    \( \newcommand\BBA{\boldsymbol\RA}\)
    \( \newcommand\BBB{\boldsymbol\RB}\)
    \( \newcommand\BBC{\boldsymbol\RC}\)
    \( \newcommand\BBD{\boldsymbol\RD}\)
    \( \newcommand\BBE{\boldsymbol\RE}\)
    \( \newcommand\BBF{\boldsymbol\RF}\)
    \( \newcommand\BBG{\boldsymbol\RG}\)
    \( \newcommand\BBH{\boldsymbol\RH}\)
    \( \newcommand\BBI{\boldsymbol\RI}\)
    \( \newcommand\BBJ{\boldsymbol\RJ}\)
    \( \newcommand\BBK{\boldsymbol\RK}\)
    \( \newcommand\BBL{\boldsymbol\RL}\)
    \( \newcommand\BBM{\boldsymbol }\)
    \( \newcommand\BBN{\boldsymbol\RN}\)
    \( \newcommand\BBO{\boldsymbol\RO}\)
    \( \newcommand\BBP{\boldsymbol\RP}\)
    \( \newcommand\BBQ{\boldsymbol\RQ}\)
    \( \newcommand\BBR{\boldsymbol\RR}\)
    \( \newcommand\BBS{\boldsymbol\RS}\)
    \( \newcommand\BBT{\boldsymbol\RT}\)
    \( \newcommand\BBU{\boldsymbol\RU}\)
    \( \newcommand\BBV{\boldsymbol\RV}\)
    \( \newcommand\BBW{\boldsymbol\RW}\)
    \( \newcommand\BBX{\boldsymbol\RX}\)
    \( \newcommand\BBY{\boldsymbol\RY}\)
    \( \newcommand\BBZ{\boldsymbol\RZ}\)
    \( \newcommand\BBa{\boldsymbol\Ra}\)
    \( \newcommand\BBb{\boldsymbol\Rb}\)
    \( \newcommand\BBc{\boldsymbol\Rc}\)
    \( \newcommand\BBd{\boldsymbol\Rd}\)
    \( \newcommand\BBe{\boldsymbol\Re}\)
    \( \newcommand\BBf{\boldsymbol\Rf}\)
    \( \newcommand\BBg{\boldsymbol\Rg}\)
    \( \newcommand\BBh{\boldsymbol\Rh}\}\)
    \( \newcommand\BBi{\boldsymbol\Ri}\)
    \( \newcommand\BBj{\boldsymbol\Rj}\)
    \( \newcommand\BBk{\boldsymbol\Rk}\)
    \( \newcommand\BBl{boldsymbol\Rl}\)
    \( \newcommand\BBm{\boldsymbol }\)
    \( \newcommand\BBn{\boldsymbol\Rn}\)
    \( \newcommand\BBo{\boldsymbol\Ro}\)
    \( \newcommand\BBp{\boldsymbol\Rp}\)
    \( \newcommand\BBq{\boldsymbol\Rq}\)
    \( \newcommand\BBr{\boldsymbol\Rr}\)
    \( \newcommand\BBs{\boldsymbol\Rs}\)
    \( \newcommand\BBt{\boldsymbol\Rt}\)
    \( \newcommand\BBu{\boldsymbol\Ru}\)
    \( \newcommand\BBv{\boldsymbol\Rv}\)
    \( \newcommand\BBw{\boldsymbol\Rw}\)
    \( \newcommand\BBx{\boldsymbol\Rx}\)
    \( \newcommand\BBy{\boldsymbol\Ry}\)
    \( \newcommand\BBz{\boldsymbol\Rz}\)
    \( \newcommand\tcb{\textcolor{blue}\)
    \( \newcommand\tcr{\textcolor{red}\)
    \( \newcommand\bnabla{\boldsymbol{\nabla}}\)
    \( \newcommand\Bell{\boldsymbol\ell}\)
    \( \newcommand\dbar{\,{\mathchar'26\mkern-12mu d}} \)
    \( \newcommand\ns{^\vphantom{*}}\)
    \( \newcommand\uar{\uparrow}\)
    \( \newcommand\dar{\downarrow}\)
    \( \newcommand\impi{\int\limits_{-\infty}^{\infty}\!\!}\)
    \( \newcommand\izpi{\int\limits_{0}^{\infty}\!\!}\)
    \( \newcommand\etc{\it etc.\/}\)
    \( \newcommand\etal{\it et al.\/}\)
    \( \newcommand\opcit{\it op. cit.\/}\)
    \( \newcommand\ie{\it i.e.\/}\)
    \( \newcommand\Ie{\it I.e.\/}\)
    \( \newcommand\viz{\it viz.\/}\)
    \( \newcommand\eg{\it e.g.\/}\)
    \( \newcommand\Eg{\it E.g.\/}\)
    \( \newcommand\dbar{\,{\mathchar'26\mkern-12mu d}} \)
    \( \def\sss#1{\scriptscriptstyle #1}\)
    \( \def\ss#1{\scriptstyle #1}\)
    \( \def\ssr#1{\scriptstyle #1}\)
    \( \def\ssf#1{\scriptstyle #1}\)
    \( \newcommand\NA{N_{\ssr{\!A}}}\)
    \( \newcommand\lala{\langle\!\langle}\)
    \( \newcommand\rara{\rangle\!\rangle}\)
    \( \newcommand\blan{\big\langle}\)
    \( \newcommand\bran{\big\rangle}\)
    \( \newcommand\Blan{\Big\langle}\)
    \( \newcommand\Bran{\Big\rangle}\)
    \( \newcommand\intl{\int\limits}\)
    \( \newcommand\half{\frac{1}{2}}\)
    \( \newcommand\third{\frac{1}{3}}\)
    \( \newcommand\fourth{\frac{1}{4}}\)
    \( \newcommand\eighth{\frac{1}{8}}\)
    \( \newcommand\uar{\uparrow}\)
    \( \newcommand\dar{\downarrow}\)
    \( \newcommand\undertext#1{$\underline{\hbox{#1}}$}\)
    \( \newcommand\Tra{\mathop{\textsf{Tr}}\,}\)
    \( \newcommand\det{\mathop{\textsf{det}}\,}\)
    \( \def\tket#1{|  #1 \rangle}\)
    \( \def\tbra#1{\langle #1|}\)
    \( \def\tbraket#1#2{\langle #1  |   #2 \rangle}\)
    \( \def\texpect#1#2#3{\langle #1 |   #2  |  #3 \rangle}\)
    \( \def\sket#1{|  \, #1 \,  \rangle}\)
    \( \def\sbra#1{\langle \,  #1 \, |}\)
    \( \def\sbraket#1#2{\langle \, #1  \, |  \, #2 \,  \rangle}\)
    \( \def\sexpect#1#2#3{\langle \, #1 \, | \,  #2  \, | \, #3 \, \rangle}\)
    \(\def\ket#1{\big| \, #1\, \big\rangle}\)
    \( \def\bra#1{\big\langle \, #1 \, \big|}\)
    \( \def\braket#1#2{\big\langle \, #1\, \big| \,#2 \,\big\rangle}\)
    \( \def\expect#1#2#3{\big\langle\, #1\, \big|\, #2\, \big| \,#3\, \big\rangle}\)
    \( \newcommand\pz{\partial}\)
    \( \newcommand\pzb{\bar{\partial}}\)
    \( \newcommand\svph{\vphantom{\int}}\)
    \( \newcommand\vph{\vphantom{\sum_i}}\)
    \( \newcommand\bvph{\vphantom{\sum_N^N}}\)
    \( \newcommand\nd{^{\vphantom{\dagger}}}\)
    \( \newcommand\ns{^{\vphantom{*}}}\)
    \( \newcommand\yd{^\dagger}\)
    \( \newcommand\zb{\bar z}\)
    \( \newcommand\zdot{\dot z}\)
    \( \newcommand\zbdot{\dot{\bar z}}\)
    \( \newcommand\kB{k_{\sss{B}}}\)
    \( \newcommand\kT{k_{\sss{B}}T}\)
    \( \newcommand\gtau{g_\tau}\)
    \( \newcommand\Htil{\tilde H}\)
    \( \newcommand\pairo{(\phi\nd_0,J\nd_0)}\)
    \( \newcommand\pairm{(\phi\nd_0,J)}\)
    \( \newcommand\pairob{(\Bphi\nd_0,\BJ\nd_0)}\)
    \( \newcommand\pairmb{(\Bphi\nd_0,\BJ)}\)
    \( \newcommand\pair{(\phi,J)}\)
    \( \newcommand\Hz{H\nd_0}\)
    \( \newcommand\Ho{H\nd_1}\)
    \( \newcommand\Htz{\Htil\nd_0}\)
    \( \newcommand\Hto{\Htil\nd_1}\)
    \( \newcommand\oc{\omega_\Rc}\)

    \(\newcommand \gtwid{\approx}\)

    \( \newcommand\index{\textsf{ind}}\)
    \( \newcommand\csch{\,{ csch\,}}\)
    \( \newcommand\ctnh{\,{ ctnh\,}}\)
    \( \newcommand\ctn{\,{ ctn\,}}\)
    \( \newcommand\sgn{\,{ sgn\,}}\)
    \( \def\tmapright#1{\xrightarrow \limits^{#1}}\)
    \( \def\bmapright#1{\xrightarrow\limits_{#1}}\)
    \( \newcommand\hfb{\hfill\break}\)
    \( \newcommand\Rep{\textsf{Re}\,}\)
    \( \newcommand\Imp{\textsf{Im}\,}\)
    \( \newcommand\ncdot{\!\cdot\!}\)
    \( \def\tmapright#1{ \smash{\mathop{\hbox to 35pt{\rightarrowfill}}\limits^{#1}}\ }\)
    \( \def\bmapright#1{ \smash{\mathop{\hbox to 35pt{\rightarrowfill}}\limits_{#1}}\ }\)
    \( \newcommand\bsqcap{\mbox{\boldmath{$\sqcap$}}}\)

    \( \def\pabc#1#2#3{\left({\pz #1\over\pz #2}\right)\ns_{\!\!#3}}\)
    \( \def\spabc#1#2#3{\big({\pz #1\over\pz #2}\big)\ns_{\!#3}}\)
    \( \def\qabc#1#2#3{\pz^2\! #1\over\pz #2\,\pz #3}\)
    \( \def\rabc#1#2#3#4{(\pz #1,\pz #2)\over (\pz #3,\pz #4)}\)
    \( \newcommand\subA{\ns_\ssr{A}}\)
    \( \newcommand\subB{\ns_\ssr{B}}\)
    \( \newcommand\subC{\ns_\ssr{C}}\)
    \( \newcommand\subD{\ns_\ssr{D}}\)
    \( \newcommand\subAB{\ns_\ssr{AB}}\)
    \( \newcommand\subBC{\ns_\ssr{BC}}\)
    \( \newcommand\subCD{\ns_\ssr{CD}}\)
    \( \newcommand\subDA{\ns_\ssr{DA}}\)
    \( \def\lmapright#1{\ \ \smash{\mathop{\hbox to 55pt{\rightarrowfill}}\limits^{#1}}\ \ }\)
    \( \def\enth#1{\RDelta {\textsf H}^0_\Rf[{ #1}]}\)
    \( \newcommand\longrightleftharpoons{ \mathop{\vcenter{\hbox{\ooalign{\raise1pt\hbox{$\longrightharpoonup\joinrel$}\crcr  \lower1pt\hbox{$\longleftharpoondown\joinrel$}}}}}}\)
    \( \newcommand\longrightharpoonup{\relbar\joinrel\rightharpoonup}\)
    \( \newcommand\longleftharpoondown{\leftharpoondown\joinrel\relbar}\)
    \( \newcommand\cds{\,\bullet\,}\)
    \( \newcommand\ccs{\,\circ\,}\)
    \( \newcommand\nsub{_{\vphantom{\dagger}}}\)
    \( \newcommand\rhohat{\hat\rho}\)
    \( \newcommand\vrhhat{\hat\vrh}\)
    \( \newcommand\impi{\int\limits_{-\infty}^\infty\!\!\!}\)
    \( \newcommand\brangle{\big\rangle}\)
    \( \newcommand\blangle{\big\langle}\)
    \( \newcommand\vet{\tilde\ve}\)
    \( \newcommand\zbar{\bar z}\)
    \( \newcommand\ftil{\tilde f}\)
    \( \newcommand\XBE{\RXi\ns_\ssr{BE}}\)
    \( \newcommand\XFD{\RXi\ns_\ssr{FD}}\)
    \( \newcommand\OBE{\Omega\ns_\ssr{BE}}\)
    \( \newcommand\OFD{\Omega\ns_\ssr{FD}}\)
    \( \newcommand\veF{\ve\ns_\RF}\)
    \( \newcommand\kF{k\ns_\RF}\)
    \( \newcommand\kFu{k\ns_{\RF\uar}}\)
    \( \newcommand\SZ{\textsf Z}}\) \( \newcommand\kFd{k\ns_{\RF\dar}\)
    \( \newcommand\muB{\mu\ns_\ssr{B}}\)
    \( \newcommand\mutB{\tilde\mu}\ns_\ssr{B}\)
    \( \newcommand\xoN{\Bx\ns_1\,,\,\ldots\,,\,\Bx\ns_N}\)
    \( \newcommand\rok{\Br\ns_1\,,\,\ldots\,,\,\Br\ns_k}\)
    \( \newcommand\xhiOZ{\xhi^\ssr{OZ}}\)
    \( \newcommand\xhihOZ
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/span[1], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\jhz{\HJ(0)}\)
    \( \newcommand\nda{\nd_\alpha}\)
    \( \newcommand\ndap{\nd_{\alpha'}}\)
    \( \newcommand\labar
    ParseError: invalid DekiScript (click for details)
    Callstack:
        at (Template:MathJaxArovas), /content/body/div/span[2], line 1, column 1
        at template()
        at (Bookshelves/Thermodynamics_and_Statistical_Mechanics/Book:_Thermodynamics_and_Statistical_Mechanics_(Arovas)/01:_Fundamentals_of_Probability/1.04:_General_Aspects_of_Probability_Distributions), /content/body/p/span, line 1, column 23
    
    \)
    \( \newcommand\msa{m\ns_\ssr{A}}\)
    \( \newcommand\msb{m\ns_\ssr{B}}\)
    \( \newcommand\mss{m\ns_\Rs}\)
    \( \newcommand\HBx{\hat\Bx}\)
    \( \newcommand\HBy{\hat\By}\)
    \( \newcommand\HBz{\hat\Bz}\)
    \( \newcommand\thm{\theta\ns_m}\)
    \( \newcommand\thp{\theta\ns_\phi}\)
    \( \newcommand\mtil{\widetilde m}\)
    \( \newcommand\phitil{\widetilde\phi}\)
    \( \newcommand\delf{\delta\! f}\)
    \( \newcommand\coll{\bigg({\pz f\over\pz t}\bigg)\nd_{\! coll}}\)
    \( \newcommand\stre{\bigg({\pz f\over\pz t}\bigg)\nd_{\! str}}\)
    \( \newcommand\idrp{\int\!\!{d^3\!r\,d^3\!p\over h^3}\>}\)
    \( \newcommand\vbar{\bar v}\)
    \( \newcommand\BCE{\mbox{\boldmath{$\CE$}}\!}\)
    \( \newcommand\BCR{\mbox{\boldmath{$\CR$}}\!}\)
    \( \newcommand\gla{g\nd_{\RLambda\nd}}\)
    \( \newcommand\TA{T\ns_\ssr{A}}\)
    \( \newcommand\TB{T\ns_\ssr{B}}\)
    \( \newcommand\ncdot{\!\cdot\!}\)
    \( \newcommand\NS{N\ns_{\textsf S}}\)

    Discrete and Continuous Distributions

    Consider a system whose possible configurations \(\sket{n}\) can be labeled by a discrete variable \(n\in \CC\), where \(\CC\) is the set of possible configurations. The total number of possible configurations, which is to say the order of the set \(\CC\), may be finite or infinite. Next, consider an ensemble of such systems, and let \(P\ns_n\) denote the probability that a given random element from that ensemble is in the state (configuration) \(\sket{n}\). The collection \(\{P\ns_n\}\) forms a discrete probability distribution. We assume that the distribution is normalized, meaning \[\sum_{n\in\CC} P\ns_n=1\ .\]

    Now let \(A\ns_n\) be a quantity which takes values depending on \(n\). The average of \(A\) is given by \[\langle A\rangle =\sum_{n\in\CC} P\ns_n\,A\ns_n\ .\] Typically, \(\CC\) is the set of integers (\(\MZ\)) or some subset thereof, but it could be any countable set. As an example, consider the throw of a single six-sided die. Then \(P\ns_n=\frac{1}{6}\) for each \(n\in\{1,\ldots,6\}\). Let \(A\ns_n=0\) if \(n\) is even and \(1\) if \(n\) is odd. Then find \(\langle A\rangle=\half\), on average half the throws of the die will result in an even number.

    It may be that the system’s configurations are described by several discrete variables \(\{n\ns_1,n\ns_2,n\ns_3,\ldots\}\). We can combine these into a vector \(\Bn\) and then we write \(P\ns_\Bn\) for the discrete distribution, with \(\sum_\Bn P\ns_\Bn=1\).

    Another possibility is that the system’s configurations are parameterized by a collection of continuous variables, \(\Bvphi=\{\varphi\ns_1,\ldots,\varphi\ns_n\}\). We write \(\Bvphi\in\ROmega\), where \(\ROmega\) is the phase space (or configuration space) of the system. Let \(d\mu\) be a measure on this space. In general, we can write \[d\mu=W(\varphi\ns_1,\ldots,\varphi\ns_n)\, d\varphi\ns_1\,d\varphi\ns_2\cdots d\varphi\ns_n\ .\] The phase space measure used in classical statistical mechanics gives equal weight \(W\) to equal phase space volumes: \[d\mu=\CC\prod_{\sigma=1}^r dq\ns_\sigma\,dp\ns_\sigma\ ,\] where \(\CC\) is a constant we shall discuss later on below8.

    Any continuous probability distribution \(P(\Bvphi)\) is normalized according to \[\int\limits_\ROmega\!\!d\mu\,P(\Bvphi)=1\ .\] The average of a function \(A(\Bvphi)\) on configuration space is then \[\langle A\rangle =\int\limits_\ROmega\!\!d\mu\, P(\Bvphi)\,A(\Bvphi)\ .\] For example, consider the Gaussian distribution \[P(x)={1\over\sqrt{2\pi\sigma^2}}\,e^{-(x-\mu)^2/2\sigma^2}\ . \label{pgauss}\] From the result9 \[\impi dx\>e^{-\alpha x^2}\,e^{-\beta x}=\sqrt{\pi\over\alpha} \ e^{\beta^2/4\alpha}\ ,\] we see that \(P(x)\) is normalized. One can then compute \[\begin{split} \langle x\rangle&=\mu\\ \langle x^2\rangle-\langle x\rangle^2 &=\sigma^2\ . \end{split}\] We call \(\mu\) the mean and \(\sigma\) the standard deviation of the distribution, Equation [pgauss].

    The quantity \(P(\Bvphi)\) is called the distribution or probability density. One has \[P(\Bvphi)\,d\mu = \hbox{probability that configuration lies within volume $d\mu$ centered at $\Bvphi$}\] For example, consider the probability density \(P=1\) normalized on the interval \(x\in\big[0,1\big]\). The probability that some \(x\) chosen at random will be exactly \(\half\), say, is infinitesimal – one would have to specify each of the infinitely many digits of \(x\). However, we can say that \(x\in\big[0.45\,,\,0.55\big]\) with probability \(\frac{1}{10}\).

    If \(x\) is distributed according to \(P\ns_1(x)\), then the probability distribution on the product space \((x\ns_1\,,\,x\ns_2)\) is simply the product of the distributions: \(P\ns_2(x\ns_1,x\ns_2)=P\ns_1(x\ns_1)\,P\ns_1(x\ns_2)\). Suppose we have a function \(\phi(x\ns_1,\ldots,x\ns_N)\). How is it distributed? Let \(P(\phi)\) be the distribution for \(\phi\). We then have \[\begin{split} P(\phi)&=\impi dx\ns_1\cdots\impi dx\ns_N\,P\ns_N(x\ns_1,\ldots,x\ns_N)\> \delta\Big(\phi(x\ns_1,\ldots,x\ns_N)-\phi\Big)\\ &=\impi dx\ns_1\cdots\!\impi dx\ns_N\,P\ns_1(x\ns_1)\cdots P\ns_1(x\ns_N)\> \delta\Big(\phi(x\ns_1,\ldots,x\ns_N)-\phi\Big)\ , \end{split}\] where the second line is appropriate if the \(\{x\ns_j\}\) are themselves distributed independently. Note that \[\impi d\phi\>P(\phi) = 1\ ,\] so \(P(\phi)\) is itself normalized.

    Central limit theorem

    In particular, consider the distribution function of the sum \(X=\sum_{i=1}^N x\ns_i\). We will be particularly interested in the case where \(N\) is large. For general \(N\), though, we have \[P\ns_N(X)=\impi dx\ns_1\cdots\!\impi dx\ns_N\,P\ns_1(x\ns_1)\cdots P\ns_1(x\ns_N)\> \delta\big(x\ns_1+x\ns_2+\ldots+x\ns_N-X\big)\ .\] It is convenient to compute the Fourier transform10 of \(P(X)\): \[\begin{split} {\hat P}\ns_N(k)&=\impi dX\,P\ns_N(X)\,e^{-ikX}\\ &=\impi dX\!\!\impi dx\ns_1\cdots\!\impi dx\ns_N\,P\ns_1(x\ns_1)\cdots P\ns_1(x\ns_N) \>\delta\big(x\ns_1+\ldots+x\ns_N-X)\,e^{-ikX}=\big[{\hat P\ns_1}(k)\big]^N\ , \end{split}\] where \[{\hat P}\ns_1(k)=\impi dx\,P\ns_1(x)\,e^{-ikx}\] is the Fourier transform of the single variable distribution \(P\ns_1(x)\). The distribution \(P\ns_N(X)\) is a convolution of the individual \(P\ns_1(x\ns_i)\) distributions. We have therefore proven that the Fourier transform of a convolution is the product of the Fourier transforms.

    OK, now we can write for \({\hat P}\ns_1(k)\) \[\begin{split} {\hat P}\ns_1(k)&=\impi dx\,P\ns_1(x)\,\big(1-ikx -\half \,k^2 x^2 +\frac{1}{6}\,i \,k^3\,x^3 + \ldots\big)\\ &=1-ik\langle x\rangle -\half\, k^2\langle x^2\rangle +\frac{1}{6} \, i\,k^3\langle x^3\rangle + \ldots \ . \end{split}\] Thus, \[\ln{\hat P}\ns_1(k)=-i\mu k -\half\sigma^2 k^2 + \frac{1}{6}\,i\,\gamma^3\,k^3+\ldots\ ,\] where \[\begin{split} \mu&=\langle x\rangle\\ \sigma^2&=\langle x^2\rangle - \langle x\rangle ^2\\ \gamma^3&=\langle x^3\rangle-3\,\langle x^2\rangle\,\langle x\rangle + 2\,\langle x\rangle^3 \end{split}\] We can now write \[\big[{\hat P}\ns_1(k)\big]^N=e^{-iN\mu k}\, e^{-N \sigma^2 k^2/2}\, e^{iN\gamma^3 k^3/6}\cdots\] Now for the inverse transform. In computing \(P\ns_N(X)\), we will expand the term \(e^{iN\gamma^3 k^3/6}\) and all subsequent terms in the above product as a power series in \(k\). We then have \[\begin{split} P\ns_N(X)&=\impi{dk\over 2\pi}\ e^{ik(X-N\mu)}\,e^{-N\sigma^2 k^2/2}\>\Big\{1+\frac{1}{6}\, i\,N\gamma^3 k^3 + \ldots\Big\}\\ &=\bigg(1-{\gamma^3\over 6} N\, {\pz^3\over\pz X^3} + \ldots \bigg) {1\over\sqrt{2\pi N\sigma^2}}\, e^{-(X-N\mu)^2/2N\sigma^2}\bvph\\ &=\bigg(1-{\gamma^3\over 6}\,N^{-1/2}\, {\pz^3\over\pz \xi^3} + \ldots \bigg) {1\over\sqrt{2\pi N\sigma^2}}\, e^{-\xi^2/2\sigma^2}\ . \end{split}\] In going from the second line to the third, we have written \(X=N\mu+\sqrt{N}\,\xi\), in which case \(\pz\ns_X=N^{-1/2}\,\pz\ns_\xi\), and the non-Gaussian terms give a subleading contribution which vanishes in the \(N\to\infty\) limit. We have just proven the central limit theorem: in the limit \(N\to\infty\), the distribution of a sum of \(N\) independent random variables \(x\ns_i\) is a Gaussian with mean \(N\mu\) and standard deviation \(\sqrt{N}\,\sigma\). Our only assumptions are that the mean \(\mu\) and standard deviation \(\sigma\) exist for the distribution \(P\ns_1(x)\). Note that \(P\ns_1(x)\) itself need not be a Gaussian – it could be a very peculiar distribution indeed, but so long as its first and second moment exist, where the \(k^\ssr{th}\) moment is simply \(\langle x^k\rangle\), the distribution of the sum \(X=\sum_{i=1}^N x\ns_i\) is a Gaussian.

    Moments and cumulants

    Consider a general multivariate distribution \(P(x\ns_1,\ldots,x\ns_N)\) and define the multivariate Fourier transform \[\HP(k\ns_1,\ldots,k\ns_N)=\impi dx\ns_1\cdots\!\!\impi dx\ns_N\>P(x\ns_1,\ldots,x\ns_N)\,\exp\bigg(\!-i\sum_{j=1}^N k\ns_j x\ns_j\bigg)\ .\] The inverse relation is \[P(x\ns_1,\ldots,x\ns_N)=\impi {dk\ns_1\over 2\pi}\cdots\!\!\impi {dk\ns_N\over 2\pi}\> \HP(k\ns_1,\ldots,k\ns_N)\,\exp\bigg(\!+i\sum_{j=1}^N k\ns_j x\ns_j\bigg)\ .\] Acting on \(\HP(\Bk)\), the differential operator \(i\,{\pz\over\pz k\ns_i}\) brings down from the exponential a factor of \(x\ns_i\) inside the integral. Thus, \[\Bigg[\bigg(\!i\,{\pz\over\pz k\ns_1}\bigg)^{\!m\ns_1}\!\!\cdots\bigg(\!i\,{\pz\over\pz k\ns_N}\bigg)^{\!m\ns_N}\,\HP(\Bk) \Bigg]\nd_{\Bk=0} \!\!\!\!=\blangle x_1^{m\ns_1}\cdots x_N^{m\ns_N}\brangle\ .\] Similarly, we can reconstruct the distribution from its moments, viz. \[\HP(\Bk)=\sum_{m\ns_1=0}^\infty\cdots\sum_{m\ns_N=0}^\infty {(-i k\ns_1)^{m\ns_1}\over m\ns_1!}\cdots {(-i k\ns_N)^{m\ns_N}\over m\ns_N!}\, \blangle x_1^{m\ns_1}\cdots x_N^{m\ns_N}\brangle\ .\]

    The cumulants \(\langle\!\langle x_1^{m\ns_1}\cdots x_N^{m\ns_N} \rangle\!\rangle\) are defined by the Taylor expansion of \(\ln \HP(\Bk)\): \[\ln\HP(\Bk)=\sum_{m\ns_1=0}^\infty\cdots\sum_{m\ns_N=0}^\infty {(-i k\ns_1)^{m\ns_1}\over m\ns_1!}\cdots {(-i k\ns_N)^{m\ns_N}\over m\ns_N!}\, \big\langle\!\big\langle x_1^{m\ns_1}\cdots x_N^{m\ns_N}\big\rangle\!\big\rangle\ .\] There is no general form for the cumulants. It is straightforward to derive the following low order results: \[\begin{split} \langle\!\langle x\ns_i \rangle\!\rangle&= \langle x\ns_i \rangle \\ \langle\!\langle x\ns_i x\ns_j\rangle\!\rangle&= \langle x\ns_i x\ns_j \rangle - \langle x\ns_i\rangle \langle x\ns_j\rangle \\ \langle\!\langle x\ns_i x\ns_j x\ns_k \rangle\!\rangle&= \langle x\ns_i x\ns_j x\ns_k \rangle - \langle x\ns_i x\ns_j \rangle \langle x\ns_k \rangle - \langle x\ns_j x\ns_k \rangle \langle x\ns_i \rangle - \langle x\ns_k x\ns_i \rangle \langle x\ns_j \rangle + 2 \langle x\ns_i \rangle \langle x\ns_j \rangle \langle x\ns_k \rangle \ . \end{split}\]

    Multidimensional Gaussian integral

    Consider the multivariable Gaussian distribution, \[P(\Bx)\equiv \bigg({\det\!A\over (2\pi)^n}\bigg)^{\!1/2}\exp\Big(-\half \, x\ns_i \, A\ns_{ij} \, x\ns_j\Big)\ ,\] where \(A\) is a positive definite matrix of rank \(n\). A mathematical result which is extremely important throughout physics is the following: \[Z(\Bb)=\bigg({\det\!A\over (2\pi)^n}\bigg)^{\!1/2}\impi dx\ns_1\cdots\!\impi dx\ns_n \> \exp\Big(-\half \, x\ns_i \, A\ns_{ij} \, x\ns_j + b\ns_i\,x\ns_i\Big)=\exp\Big(\half \, b\ns_i\,A^{-1}_{ij}\,b\ns_j\Big)\ .\] Here, the vector \(\Bb=(b\ns_1\,,\,\ldots\,,\,b\ns_n)\) is identified as a source. Since \(Z(0)=1\), we have that the distribution \(P(\Bx)\) is normalized. Now consider averages of the form \[\begin{split} \langle \, x\ns_{j\ns_1}\!\!\cdots \,x\ns_{j\ns_{2k}} \, \rangle &= \int\!d^n\!x\>P(\Bx)\>x\ns_{j\ns_1}\!\!\cdots \,x\ns_{j\ns_{2k}} ={\pz^n\!Z(\Bb)\over\pz b\ns_{j\ns_1}\!\cdots\>\pz b\ns_{j\ns_{2k}}}\bigg|\nd_{\Bb=0} \\ &=\sum_{contractions} \!\!\! A^{-1}_{j\ns_{\sigma(1)} j\ns_{\sigma(2)}} \!\!\cdots A^{-1}_{j\ns_{\sigma(2k-1)} j\ns_{\sigma(2k)}}\ . \end{split}\] The sum in the last term is over all contractions of the indices \(\{j\ns_1\,,\,\ldots\,,\,j\ns_{2k}\}\). A contraction is an arrangement of the \(2k\) indices into \(k\) pairs. There are \(C\ns_{2k}=(2k)!/2^k k!\) possible such contractions. To obtain this result for \(C\ns_k\), we start with the first index and then find a mate among the remaining \(2k-1\) indices. Then we choose the next unpaired index and find a mate among the remaining \(2k-3\) indices. Proceeding in this manner, we have \[C\ns_{2k}=(2k-1)\cdot(2k-3)\cdots 3\cdot 1 = {(2k)!\over 2^k k!}\ .\] Equivalently, we can take all possible permutations of the \(2k\) indices, and then divide by \(2^k k!\) since permutation within a given pair results in the same contraction and permutation among the \(k\) pairs results in the same contraction. For example, for \(k=2\), we have \(C\ns_4=3\), and \[\langle \, x\ns_{j\ns_1} x\ns_{j\ns_2} x\ns_{j\ns_3} x\ns_{j\ns_4 \, }\rangle = A^{-1}_{j\ns_1 j\ns_2} A^{-1}_{j\ns_3 j\ns_4} + A^{-1}_{j\ns_1 j\ns_3} A^{-1}_{j\ns_2 j\ns_4} + A^{-1}_{j\ns_1 j\ns_4} A^{-1}_{j\ns_2 j\ns_3} \ .\] If we define \(b\ns_i=ik\ns_i\), we have \[\HP(\Bk)=\exp\Big(\!-\half\, k\ns_i \, A^{-1}_{ij}\,k\ns_j\Big)\ ,\] from which we read off the cumulants \(\langle\!\langle x\ns_i x\ns_j \rangle\!\rangle= A^{-1}_{ij}\), with all higher order cumulants vanishing.


    This page titled 1.4: General Aspects of Probability Distributions is shared under a CC BY-NC-SA license and was authored, remixed, and/or curated by Daniel Arovas.

    • Was this article helpful?