The statistical description of a system of interacting particles has a fundamental physical interest. In that context, the interacting system provides a model of fundamental interest for which ideas of statistical mechanics and thermodynamics can be tested and developed. For self-gravitating system the thermodynamical ensemble can be nonequivalent   . In particular, since energy is not-additive, and cannot use the canonical ensemble to study the system with long-range interaction. Since equilibrium states are only local entropy maximum.
Two type approaches (statistical and thermodynamic) have been developed to determine the equilibrium states of the interacting system and describe possible phase transition. It is generally believed that mean field theory is exact for systems. Since in mean field theory any thermodynamical function depends on the thermodynamical variables only through the dimensionless combinations and the system is thermodynamically stable but the thermodynamical limit does exist  .
Formation of the spatially inhomogeneous distribution of interaction particles is a typical problem in condensed matter physics and requires non-conventional methods of the statistical description of the system tailored to gravitational interacting particles with regard for an arbitrary spatially inhomogeneous particles distribution. Statistical description must employ the procedure to find dominant contributions to the partition function and to avoid entropy divergences for infinite system volume. Formation of the inhomogeneous distribution of interaction particles requires a non-conventional method, which was proposal in      . This method is based on Hubbard-Stratonovich representation of statistical sum  which is now extended and applied to the self-gravitating system to find solution for particles distribution without using spatial box restrictions. It is important that this solution has no divergences in thermodynamic limits. For this goal using the saddle point approximation took into account the conservation number of particles in limiting space and provided to nonlinear equation. The partition function in the case of homogeneous distribution of the particles, and in case of inhomogeneous distribution was obtained in    , but in this approach described only condition in the formation of the possible inhomogeneous distribution of the interacting particles.
Systems with long-range interactions, such as self-gravitating system do not relax to the usual Boltzmann-Gibbs thermodynamic equilibrium, but become trapped in quasi-stationary states, the lifetime of which diverges with the number of particles. The instability threshold was predicted for spontaneous symmetry breaking for a class of d-dimensional systems  . Non-equilibrium stationary states of systems were described in article  where concluded that three-dimensional systems do not evolve to thermodynamic equilibrium but trap in non-equilibrium quasi-stationary states.
Mostly due to the fact that self-gravitating system exist in a states that far from equilibrium and the relaxation time to equilibrium state is very long. The homogeneous particle distribution in a self-gravitating system is not stable. The particles distribution in such a system is inhomogeneous in space, from the beginning. There is standardized behavior of the interacting system, it is described differently for different equilibrium ensembles. That approach does not seem to be very consistent, due to the fact that, the state equation has to come from the definition of partition function, but the definition of it is unknown for the space inhomogeneous systems   . Therefore, there is a dilemma, either to take the postulates of equilibrium statistical mechanics to obtain only instability criteria or not to try to account for the space in homogeneity using different approach. Such inhomogeneous distribution of the particles, temperature and chemical potential can be accounted for in non-equilibrium statistical operator approach  , where possibility of local change of thermodynamic parameters is included. This system is non-equilibrium and inhomogeneous distribution of particle can motivate the inhomogeneous distribution of temperature and chemical potential and other thermodynamic parameter.
In this article are proposed the new approach, based on non-equilibrium statistic operator  , which are more suitable for the description of a self- gravitating systems. The equation of state and all thermodynamic characteristics needed are defined by the equations which contribute the most to the partition function. Therefore, there is no need to introduce additional hypothesis about temperature on density dependence. This dependence is an outcome of solving corresponding thermodynamic relations, which describe extreme of non-equilibrium partition function. The possible space inhomogeneous distributions of particles and temperature have been obtained for the simple cases. For the equilibrium case the well-known result   of partition function has been reproduced. Has been shown, that used this approach can describe inhomogeneous distribution of particle and determine necessary parameter in the self -gravitating system. The main idea of this paper is to provide a possible detailed description of self -gravitating system based on the principles of non-equilibrium statistical mechanics and obtain possible distribution particle by fixed number of particle and energy of the system. After that we can determine the dynamic of self -gravitating system which induced the statistical principles and low increasing the entropy in the case existence the thermodynamic limit.
2. Nonequilibrium Statistical Operator
Phenomenological thermodynamic based on the conservation lows for average value of physical parameter as number of particles, energy and impulse. Statistical thermodynamic non-equilibrium system based too on conservation lows not the average value dynamic variables but in particular for this dynamic variable. It present local conservation lows for dynamic variables. For the determination thermodynamic function of non- equilibrium system are teed use the presentation of corresponding statistical ensembles which take into account the non-equilibrium states of this systems. The conception of Gibbs ensembles can brings to description non-equilibrium stationary states of system. In this case can determine non-equilibrium ensemble as totality of system which be contained in same stationary external action. This system has same character of contact with thermostat and possess all possible value macroscopic parameters which compatibility present conditions. In system, which are in same stationary external condition will are formed local equilibrium stationary distribution. If external condition will be depend from time that local equilibrium distribution are not stationary. For exactly determination local equilibrium ensemble must accordingly determine the distribution function or statistical operator of the system  , finally, can recall that the stable states on the series of equilibrium of classical self-gravitating particles are only metastable because they correspond to local maximal of entropy from which can determine behavior of the system.
If assume that non-equilibrium states of system can determine through inhomogeneous distribution energy and number of particles (density) the local equilibrium distribution function for classical system can write in the form  :
present determination of statistical operator local equilibrium distribution. The integration in present formula must take over all phase space of system. Must note, that in the case local equilibrium distribution Lagrange multipliers and are function of spatial point. The microscopic density of particles can present in standard form:
The introduction local equilibrium distribution are possible if relaxation time in all system is more as relaxation time on local macroscopically area as part of this system.
After determination of non-equilibrium statistical operator can obtain all thermodynamic parameter non-equilibrium system. For this can determine thermodynamic relation for inhomogeneous systems. The variation of statistical operator by Lagrange multipliers can write necessary thermodynamic relation in the form  : and . This relation is natural general prolongation well-known relation which take place in the case equilibrium systems, on the case inhomogeneous system. The conservation number of particles and energy in system can present in form natural relations and
For further statistical description of non-equilibrium system is necessary determine Hamiltonian of system. In general case Hamiltonian of system interacting particle can present as:
where determine the attractive interaction energy. Further will be use only density of energy which for self-gravitating system can write in the following form:
This density energy of a system is possible to use if we smash to equal bits all space with equal mass and consider moving in phase space not compressed gravitational fluid. In our case interacting system can write are non-equilibrium statistical operator in the form:
The integration over phase space can present as .
In order to perform a formal integration in second part of this presentation, additional field variables can be introduced making use of the theory of Gaussian integrals   :
where and is the inverse operator which satisfies the condition , that means: the interaction energy presented the Green function for this operator and depending on the sign of the interaction or the potential energy. After present manipulation the field variable contains the same information as original distribution function, i.e. all information about possible spatial states of the systems.
After this manipulation the statistical operator can rewrite in the form:
where part which cam from interaction
In this general functional integral can be provide the integration on phase space. If use the definition of density we can rewrite the non-equilibrium statistical operator as:
where introduce the new variable which can interpreter as chemical activity. Now can make integration over impulse. Real part of non-equilibrium statistical operator take the form:
After that the non-equilibrium statistical operator take the simple form:
In definition are the reverse operator of interaction energy. For further description we must determine this inverse operator. For general case of long range interaction as Coulomb like or Newtonian gravitational interaction in continuum limit should be treated in the operator sense, i.e.
where is Laplace operator in real space. Gravitation interaction energy in three dimensional case can write in well-known form
G is gravitational constant and m is mass of separate area. For long range interaction between particle we can rewrite the non-equilibrium statistical operator in the form:
where all function are dependence from spatial point. In this presentation was using the definition thermal de-Broglie wavelength and definition of interaction length as
In general case the non-equilibrium statistical operator can rewrite in the form:
where effective non-equilibrium “local entropy” take the form:
The statistical operator allows obtain use the of efficient methods developed in the quantum field theory without imposing additional restrictions of integration over field variables or the perturbation theory. The functional depends on the distribution of the field variables , the chemical activity and inverse temperature . The saddle point method can now be further employed to find the asymptotic value of the statistical operator for increasing number of particles N to . The dominant contribution is given by the states which satisfy the extreme condition for the functional. It’s easy to see that saddle point equation present thermodynamic relation and it can write in the other form as: equation for field variable for the normalization condition and for the conservation the energy of the system Solution of this equation fully determine all thermodynamic parameter and describe general behavior of interacting system, whether this distribution of particles is spatially inhomogeneous or not. The above set of equations in principle solves the many-particle problem in thermodynamic limit. The spatially inhomogeneous solution of this equations correspondent the distribution of the interacting particles. Such inhomogeneous behavior is associated with the nature and intensity of the interaction. In other words, accumulation of particles in a finite spatial region (formation of a cluster) reflects the spatial distribution of the fields, the activity and temperature. Very important note, that only in this approach can take into account the inhomogeneous distribution temperature, which can depend from spatial distribution of particle in system.
3. Saddle-Point Equation for Self-Gravitating System
The solution of saddle-point equation completely determines all the thermodynamic parameters and describes the general behavior of a self-gravitating system both for spatially homogeneous and inhomogeneous particle distributions. The above set of equations in principle solves the many-particle problem in the thermodynamic limit. The spatially inhomogeneous solution of these equations corresponds to the distribution of the interacting particles. Such inhomogeneous behavior is associated with the nature and intensity of the interaction. In other words, accumulation of the particles in a finite spatial region (cluster formation) reflects the spatial distribution of the field, activity, and temperature. It is very important to note that only this approach makes it possible to take into account the inhomogeneity of temperature distribution that may depend on the spatial distribution of the particles in the system. In other approaches  the dependence of the temperature on a spatial point is introduced through the polytrophic dependence of temperature on particle density in the equation of state  . In the present approach, such dependence follows from the necessary thermodynamic condition, and can be found for various particle distributions. Now we derive the saddle-point equation for the extreme of the local entropy functional . The equation for the field variable in the case and absent repulsive interaction yields.
where the notation is introduced. The normalization condition may be written as
and the equation for the energy conservation in the system is given by
To draw more information on the behavior of a self-gravitating system, we introduce new variables. The normalization condition yields the definition for the density function, i.e.,
which reduces the equations to a simpler form. The equation for the field variable is given by
In the case constant temperature and chemical activity, this equation transform into an equation for gravitational potential in the well-known form:
The equation for energy conservation takes the form
Hereinafter we obtain the chemical activity in terms of chemical potential . Having differentiated the equation for energy conservation over the volume, we obtain interesting relation for the chemical potential
which yields the chemical potential to be given by
and the equation for the energy conservation reduces to very simple form: . The equation thus obtained cannot be solved in the general case, but it is possible to analyze many cases of the behavior of a self-gravitating system under various external conditions. Within the context of the expression for density, and the definition of reduced thermal de-Broglie wavelength, and the gravitation length, i.e.,
we can rewrite all the equations and the normalization condition in terms of density and temperature. Thus we have general equation in the term of concentration and temperature in the form:
The chemical potential reduces to
In this way we can obtain the equation of state for self-gravitating system if we use the thermodynamic relation for conservation energy E,
Using the definition of the density of particles, one can obtain the local entropy in the form
from which the local equation of state can present as
In general case this equation of state has a multiplier which logarithmically depends on the density of the particles. Only in the case we obtain the equation of state for an ideal gas . We have a sense to talk about pressure in classical cases only. If the concentration is large, and takes place the reverse relation , the determination of pressure are not correct. In the classical case . As shown below there is a natural limit of our approach. We cannot describe the processes which can be realize within short distances since because in a system with large concentration quantum effects would take place. In the case of the ideal gas we obtain usual equation of state, because in this case and as result absent of interaction. In the case on ideal gas and equation of state reproduce to the equilibrium relation for the ideal gas. In this case the energy of the system which corresponds to the previously obtained results   . In the next section, we find the classical distributions of particles for various inner and external conditions.
4. Statistical Induced Dynamic for Self-Gravitating System
In system not far from equilibrium, patterns may form as results of the competition long-range interactions operating of different length scales  . The latter is countered by a long range gravitation attractive interaction. This is often accompanied by the macroscopical separation transition which leads to spontaneous formation of patterns in ideally homogeneous system upon variation of control parameter. An important class of system with competing interaction is the system in which the long-range interaction is gravitational. The fundamental nature of the gravitational interaction makes this class of system extremely diverse. We stop on the point statistical induced dynamics of self-gravitating system taking into account the possible spatial distribution of particle. For this goal we must determine the dynamic equation for field variable or density of particle. In this sense we can use the Ginsburg-Landau equation for density
where is dynamic gravitational viscous coefficient  . In self-gravitating system we have not any other viscous process without dynamic influence of gravitational action, all systems on local spatial point. This evolution equation is, in fact applicable to a number of systems with non-conserved order parameter. Taking into account the presentation of local entropy in the terms of density, we can write the dynamic equation for density in the form:
The evolution of patterns in non-equilibrium will generate to be guided by the local entropy landscape and the morphological instabilities of the parameter. The dynamic of the system is dissipative, it will result in decrease of the local entropy of the patterns with time. To mimic this behavior we can use the simple gradient, descent dynamic defined with chemical potential may be considered as generalization of Cahn equation for non-uniform system with an arbitrary concentration gradient which becomes Cahn nonlinear diffusion equation  :
which is fully equivalent previous dynamic equation in Ginsburg-Landau approach. If we take the solution of this dynamic equation in the form the solution of problem reduces to solve the previous equation
and can be transformed to
for constant temperature, that means, the obtained spatial solution will be existed in all time increasing the density of particles. If we determine the possible structure in distribution of density, this pattern will be conserved in all-time decrease of density. In this approach  , the probable behavior of a self-gravitating system can be predicted for any external conditions. On much longer timescales, an evolution towards the true thermal equilibrium is postulated. In this way we can solve the complicated problem of statistical description of self-gravitating systems. Moreover, this method can also be applied for the further development of the physics of self-gravitational and similar systems that are not far from the equilibrium.
The paper is prepared with the financial support of the National Academy of Sciences of Ukraine (the project “Dynamics of structure formation in many-particle systems”) PK 0118U003535.