Ceramic membranes possessing superior properties compared to polymeric membranes are more durable under severe working conditions and therefore their service life is longer. The ceramic membranes are composed of some layers. The support is the layer composed of coarser ceramic structure and responsible for mechanical durability under filtration pressure and it is prepared by consolidation of ceramic powders. The top layer is composed of a finer ceramic micro-structure mainly responsible for the separation of components present in the fluid to be filtered and sol-gel method is a versatile tool to prepare such a tailor-made ceramic filtration structure with finer pores. Depending on the type of filtration (e.g. micro-filtration, ultra-filtration, nano-filtration) aiming separation of components with different sizes, sols with different particulate sizes should be prepared and consolidated with varying precursors and preparation conditions. The coating of sol on the support layer and heat treatment application to have a stable ceramic micro-structure are also important steps determining the final properties of the top layer. Sol-gel method with various controllable parameters (e.g. precursor type, sol formation kinetics, heat treatment conditions) is a practical tool for the preparation of top layers of ceramic composite membranes with desired physicochemical properties.