Content-aware Photo Collage Using Circle Packing

Zongqiao Yu1, 2 Lin Lu3 Yanwen Guo1, 2 Rongfei Fan1, 2 Mingming Liu1, 2 Wenping Wang4

1Department of Computer Science & Technology, Nanjing University, Nanjing 210023, China P. R.
2National Key Lab for Novel Software Technology, Nanjing University, Nanjing 210023, China P. R.
3School of Computer Science & Technology, Shandong University, Jinan 250101, China P. R.
4Department of Computer Science, The University of Hongkong, Hongkong.

IEEE Trans. on Visualization and Computer Graphics, 2014


In this paper, we present a novel approach for automatically creating the photo collage that assembles the interest regions of a given group of images naturally. Previous methods on photo collage are generally built upon a well-defined optimization framework which computes all the geometric parameters and layer indexes for input photos on the given canvas by optimizing a unified objective function. The complex non-linear form of optimization function limits their scalability and efficiency. From the geometric point of view, we recast the generation of collage as a region partition problem such that each image is displayed in its corresponding region partitioned from the canvas. The core of this is an efficient power diagram based circle packing algorithm, which arranges a series of circles assigned to input photos compactly in the given canvas. To favor important photos, the circles are associated with image importances determined by an image ranking process. A heuristic search process is developed to ensure that salient information of each photo is displayed in the polygonal area resulting from circle packing. With our new formulation, each factor influencing the state of a photo is optimized in an independent stage, and computation of the optimal states for neighboring photos are completely decoupled. This improves the scalability of collage results and ensures their diversity. We also devise a saliency-based image fusion scheme to generate seamless compositive collage. Our approach can generate the collages on non-rectangular canvases and supports interactive collage that allows the user to refine collage results according to his/her personal preferences. We conduct extensive experiments and show the superiority of our algorithm by comparing against previous methods. 

The Overall Pipeline of Our Framework

Ours(left) & Microsoft Autocollage(right)

  author = {Zongqiao Yu, Lin Lu, Yanwen Guo, Rongfei Fan, Mingming Liu, and Wenping Wang},
  title = {Content-Aware Photo Collage Using Circle Packing},
  journal ={IEEE Transactions on Visualization and Computer Graphics},
  issn = {1077-2626},
  year = {2014},
  pages = {182--195},
  doi = {},
  publisher = {IEEE Computer Society},
  address = {Los Alamitos, CA, USA},

Download the PDF              Download the software