Yes, the golgi complex is a single membrane bounded structure that consists of a system of membrane-bound vesicles arranged approximately parallel to each other in stacks called cisterns.
These membranes have connections with the membranes of ER(endoplasmic reticulum) and the material synthesised near the ER is packaged and dispatched to various targets inside and outside the cell through the Golgi apparatus. Its functions include the storage, modification and packaging of products in vesicles.