Regularizers for Vector-Valued Data and Labeling Problems in Image Processing
Дан обзор последних результатов в области регуляризаторов, основанных на полных вариациях, применительно к векторным данным. Результаты оказались полезными для хранения или улучшения мультимодальных данных и задач разметки на непрерывной области определения. Возможные регуляризаторы и их свойства ра...
Saved in:
| Date: | 2011 |
|---|---|
| Main Authors: | , |
| Format: | Article |
| Language: | English |
| Published: |
Міжнародний науково-навчальний центр інформаційних технологій і систем НАН та МОН України
2011
|
| Series: | Управляющие системы и машины |
| Subjects: | |
| Online Access: | https://nasplib.isofts.kiev.ua/handle/123456789/82923 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Journal Title: | Digital Library of Periodicals of National Academy of Sciences of Ukraine |
| Cite this: | Regularizers for Vector-Valued Data and Labeling Problems in Image Processing / J. Lellmann, C. Schnörr // Управляющие системы и машины. — 2011. — № 2. — С. 43-54. — Бібліогр.: 50 назв. — англ. |
Institution
Digital Library of Periodicals of National Academy of Sciences of Ukraine| id |
nasplib_isofts_kiev_ua-123456789-82923 |
|---|---|
| record_format |
dspace |
| spelling |
nasplib_isofts_kiev_ua-123456789-829232025-02-10T01:19:20Z Regularizers for Vector-Valued Data and Labeling Problems in Image Processing Регуляризаторы векторных данных и задачи разметки в обработке изображений Регуляризатори векторних даних та задачі розмітки в обробці зображень Lellmann, J. Schnörr, C. Оптимизационные задачи структурного распознавания образов Дан обзор последних результатов в области регуляризаторов, основанных на полных вариациях, применительно к векторным данным. Результаты оказались полезными для хранения или улучшения мультимодальных данных и задач разметки на непрерывной области определения. Возможные регуляризаторы и их свойства рассматриваются в рамках единой модели. The review of recent developments on total variation-based regularizers is given with the emphasis on vector-valued data. These have been proven to be useful for restoring or enhancing data with multiple channels, and find particular use in relaxation techniques for labeling problems on continuous domains. The possible regularizers and their properties are considered in a unified framework. Наведено огляд останніх результатів у галузі регуляризаторів, що базуються на повних варіаціях, стосовно векторних даних. Результати виявилися корисними для зберігання та покращення мультимодальних даних і задач розмітки на неперервній області визначення. Можливі регуляризатори та їх властивості розглядаються в рамках єдиної моделі. 2011 Article Regularizers for Vector-Valued Data and Labeling Problems in Image Processing / J. Lellmann, C. Schnörr // Управляющие системы и машины. — 2011. — № 2. — С. 43-54. — Бібліогр.: 50 назв. — англ. 0130-5395 https://nasplib.isofts.kiev.ua/handle/123456789/82923 004.93’1:519.157 en Управляющие системы и машины application/pdf Міжнародний науково-навчальний центр інформаційних технологій і систем НАН та МОН України |
| institution |
Digital Library of Periodicals of National Academy of Sciences of Ukraine |
| collection |
DSpace DC |
| language |
English |
| topic |
Оптимизационные задачи структурного распознавания образов Оптимизационные задачи структурного распознавания образов |
| spellingShingle |
Оптимизационные задачи структурного распознавания образов Оптимизационные задачи структурного распознавания образов Lellmann, J. Schnörr, C. Regularizers for Vector-Valued Data and Labeling Problems in Image Processing Управляющие системы и машины |
| description |
Дан обзор последних результатов в области регуляризаторов, основанных на полных вариациях, применительно к векторным данным. Результаты оказались полезными для хранения или улучшения мультимодальных данных и задач разметки на непрерывной области определения. Возможные регуляризаторы и их свойства рассматриваются в рамках единой модели. |
| format |
Article |
| author |
Lellmann, J. Schnörr, C. |
| author_facet |
Lellmann, J. Schnörr, C. |
| author_sort |
Lellmann, J. |
| title |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing |
| title_short |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing |
| title_full |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing |
| title_fullStr |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing |
| title_full_unstemmed |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing |
| title_sort |
regularizers for vector-valued data and labeling problems in image processing |
| publisher |
Міжнародний науково-навчальний центр інформаційних технологій і систем НАН та МОН України |
| publishDate |
2011 |
| topic_facet |
Оптимизационные задачи структурного распознавания образов |
| url |
https://nasplib.isofts.kiev.ua/handle/123456789/82923 |
| citation_txt |
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing / J. Lellmann, C. Schnörr // Управляющие системы и машины. — 2011. — № 2. — С. 43-54. — Бібліогр.: 50 назв. — англ. |
| series |
Управляющие системы и машины |
| work_keys_str_mv |
AT lellmannj regularizersforvectorvalueddataandlabelingproblemsinimageprocessing AT schnorrc regularizersforvectorvalueddataandlabelingproblemsinimageprocessing AT lellmannj regulârizatoryvektornyhdannyhizadačirazmetkivobrabotkeizobraženii AT schnorrc regulârizatoryvektornyhdannyhizadačirazmetkivobrabotkeizobraženii AT lellmannj regulârizatorivektornihdanihtazadačírozmítkivobrobcízobraženʹ AT schnorrc regulârizatorivektornihdanihtazadačírozmítkivobrobcízobraženʹ |
| first_indexed |
2025-12-02T11:24:02Z |
| last_indexed |
2025-12-02T11:24:02Z |
| _version_ |
1850395478179446784 |
| fulltext |
УСиМ, 2011, № 2 43
UDC 004.93’1:519.157
J. Lellmann, C. Schnörr
Regularizers for Vector-Valued Data and Labeling Problems in Image Processing
Дан обзор последних результатов в области регуляризаторов, основанных на полных вариациях, применительно к векторным
данным. Результаты оказались полезными для хранения или улучшения мультимодальных данных и задач разметки на непре-
рывной области определения. Возможные регуляризаторы и их свойства рассматриваются в рамках единой модели.
The review of recent developments on total variation-based regularizers is given with the emphasis on vector-valued data. These have
been proven to be useful for restoring or enhancing data with multiple channels, and find particular use in relaxation techniques for la-
beling problems on continuous domains. The possible regularizers and their properties are considered in a unified framework.
Наведено огляд останніх результатів у галузі регуляризаторів, що базуються на повних варіаціях, стосовно векторних даних.
Результати виявилися корисними для зберігання та покращення мультимодальних даних і задач розмітки на неперервній об-
ласті визначення. Можливі регуляризатори та їх властивості розглядаються в рамках єдиної моделі.
Abstract
We review recent developments on total varia-
tion-based regularizers, with emphasis on vector-
valued data. These have been proven to be useful
for restoring or enhancing data with multiple chan-
nels, and find particular use in recent advances on
relaxation techniques for multiclass labeling prob-
lems on continuous domains. Many of the propo-
sed approaches only differ in the norm that is
used. We provide a review of the possible regular-
izers and their properties in a unified framework.
1. Introduction
Total variation-based variational approaches in
an image processing exhibit some unique proper-
ties. Most prominently, they can be viewed as a
number of «stacked» problems on the sublevelsets
of a function, which allows to gain insight into the
structure of their minimizers, and can be applied
to finding global minimizers of segmentation/labe-
ling problems formulated on continuous domains.
This work is intended as an introductory over-
view of the field. We first discuss the related func-
tionals that are commonly used in image process-
ing (Sect. 2). Although they were originally for-
mulated for scalar-valued total variation regulariz-
ers, they can be readily extended to vector-valued
data. This occurs in particular when dealing with
convex relaxations of segmentation problems.
Recently, many different total variation-based
regularizers have been proposed in different con-
texts. We try to give a systematic account of the
Keywords: variational image segmentation, image label-
ing, convex relaxation, nonsmooth convex optimization.
existing approaches and their properties (Sect. 3).
Although the intention of this work is to provide a
broad overview on the subject, some technicalities
cannot be avoided and will be defined in the fol-
lowing section.
Preliminaries
In the following, superscripts vi denote a collec-
tion of vectors or matrix columns, while sub-
scripts vk denote vector components or matrix
rows, i.e. we denote, for d lA ,
.)||(=)||(= 1
1
d
l aaaaA (1)
We denote by := { | 0, = 1}l
l x x e x the
unit simplex in l , where := (1, ,1) le .
The i-th unit vector is denoted by ie , nI is the
identity matrix in n and
2
the usual Euclid-
ean norm for vectors resp. the Frobenius norm for
matrices. Analogously, the standard inner product
, extends to pairs of matrices as the sum over
their element-wise product. )(xr denotes the ball
of radius r in x, and 1dS the set of dx with
x =1. The indicator function )(1 x of a set is
defined as 1=)(1 x iff Sx and 0=)(1 x oth-
erwise. For a convex set , vuu v ,sup:=)(
is the support function from convex analysis.
For simplicity, we assume that the the image
domain d is the open unit box, d(0,1)= .
All results can equally be formulated for bounded
open domains with compact Lipschitz boundary.
The images or generally data with a spatial do-
main are represented as vector-valued func-
44 УСиМ, 2011, № 2
tions : lu which are absolutely integrable,
i.e. lLu )(1 .
)(k
cC is the space of k-times continuously
differentiable functions on with compact sup-
port. As usual, d denotes the d-dimensional Le-
besgue measure, while k denotes the k-dimen-
sional Hausdorff measure.
We say that : lu is of bounded varia-
tion, i.e. lBVu )( , if lLu )(1 and its distribu-
tional derivative corresponds to a finite Radon
measure; i.e. )(1 Lu j and there exist d -valued
measures ),,(= 1 jdjj uDuDDu on the Borel
subsets )( of such that
=1 =1 =1
div =
( ( )) .
l l d
i
j j j i j
j j i
d l
c
u v dx v dD u
v C
(2)
The measures in (2) form the distributional
gradient Du , which is again a measure that van-
ishes on any 1)( d -negligible set.
The total variation of u is defined as the meas-
ure-theoretic total variation of its distributional
gradient [AFP00, Prop. 3.6]: For some (possibly
vector-valued) measure on the measure space
),( X , the total variation measure of on a set
E is defined as
2
=0
| | ( ) := sup ( ) ( )k k
k
E E E
pairwise disjoint,
=0
= .k
k
E E
(3)
Consequently, the total variation of lLu )(1
is defined as
.||1=)(|:=|)( DudDuuTV (4)
The total variation also has the dual representa-
tion
( ) , ( ) 1
( ) = , Div ,sup
d lv C v xc
TV u u v dx
(5)
1Div := div , ,div .
Τ
lv v v
By partial integration, this implies that for con-
tinuously differentiable lCu )(1 ,
2( ) = ,TV u u dx
(6)
however the definition of the total variation allows
u to be discontinuous or even piecewise constant.
For more general functionals depending on Du ,
first note that Du can be represented in terms of
its density with respect to || Du , i.e. Du =
|||)|/(= DuDuDu . Since ||/ DuDu is actually a
|| Du -integrable function, the total variation is
2
( ) = | | .
| |
Du
TV u d Du
Du (7)
Based on this principle it is possible to con-
struct non-standard TV-based regularizers: For
0: d l
continuous, positively homogene-
ous and convex, we define the measure
.||
||
:=)( Du
Du
Du
Du
(8)
Essentially generates a new measure from Du
by transforming its density with respect to || Du
[AFP00, Thm. 2.38]. Note that by definition is
a seminorm, and a norm if ( )z 0=0= z .
2. TV-Based Functionals in Image Analysis
In this paper, we will be concerned with a par-
ticular class of variational problems used in image
processing and analysis. We refer to [SGG+09]
for a general overview. The output of a variational
method is defined as the minimizer
),(minarg:= ufu
u
(9)
where is some subset of a space of functions
defined on , and f a functional depending on the
input data. The interpretation of u is governed by
the problem to be solved: for the prototypical ex-
ample of color denoising, 3[0,1]: u could
directly describe the colors of the output image on
the image domain d ; while for segmenta-
tion problems, [0,1]: u could assign each
point to the foreground ( 1=)(xu ) or background
( 0=)(xu ) class. We will in particular consider
the case where u is vector-valued.
Usually the objective f is composed of a data
term )(uH and a regularizer )(uJ ,
).()(=)( uJuHuf (10)
УСиМ, 2011, № 2 45
The data term strongly depends on the input da-
ta – such as color values of a recorded image,
depth measurements, or other features – and pro-
motes a good fit of the minimizer to the input
data. However, due to the presence of noise in the
input data, it is generally necessary to incorporate
the additional prior knowledge about the «typical»
appearance of the desired output, which is the pur-
pose of the regularizer. We will now consider some
important choices for data term and regularizer.
2.1. L2 – L2: Gaussian Denoising
The central question is how to construct the in-
dividual terms, and which combinations lead to go-
od results. The most basic, classical example is
Gaussian denoising, where the goal is to find, given
an input image : lI , some : lu mi-
nimizing
2 2
2 2
1
( ) =
2 2
f u u I dx Du dx
(11)
for some weighting parameter >0. Usually u is re-
quired to be differentiable, nevertheless we use the
distributive derivative Du to simplify comparison
with the following variants. Note that both the da-
ta term and the regularizer exhibit quadratic growth.
The problem is convex, and after the discretiza-
tion can be solved globally optimal as a linear equa-
tion system. While the approach removes Gaussian
noise very well, it tends to smear hard edges in the
image. This is caused by the quadratic growth of the
regularizers, which makes it susceptible to «outli-
ers» – i.e. high gradients – in the form of hard edges.
2.2. L2 – TV: Rudin-Osher-Fatemi
Many approaches have been proposed to cir-
cumvent this problem. Most prominently, the ani-
sotropic diffusion approach consists in solving
(11) using gradient descent, at each step locally
modifying the norm in the regularizer to reduce
smoothing across directions where the current it-
erate has a large gradient, i.e. across potential
edges. While this is widely used and gives good
results in many cases, the output cannot be charac-
terized in the variational way as the minimizer of
a certain functional. A more one-step approach is
Rudin-Osher-Fatemi ( ROF ) denoising [ROF92],
2
2 2
1
( ) =
2
f u u I dx Du
. (12)
The right-hand side should be seen as a short-
hand notation for the total variation of u. The sca-
lar-valued case has been extensively studied and
works well for removing Gaussian noise while
preserving hard edges; also, the overall problem is
still convex and therefore can be solved globally
optimal. The key difference is that while the data
term still has quadratic growth, the regularizer only
grows linearly. In this paper, we will be concerned
with regularizers that also have this property.
2.3. L1 – TV
For non-Gaussian noise such as salt-and-pep-
per, (12) is suboptimal, as it is quite sensitive to
outliers in the input image I. Also, ROF denoising
invariably leads to a reduction in contrast. These
drawbacks are addressed by the L1 – TV model
(see [Nik01] for an overview),
1 2( ) = .f u u I dx Du dx
(13)
Here, both the data term as well as the regular-
izer exhibit linear growth. Existence and well-
posedness of (12) and (13) can be shown in a pre-
cise sense within the class of functions of bounded
variation [AFP00, AMT91].
The functionals such as (13) are extremely tol-
erant to noise. The downside is that they also tend
to generate a «staircasing» effect on smooth gra-
dients, i.e. the solution tends to be piecewise con-
stant. We refer to [DAG09] and the references
therein for a detailed analysis. For image denois-
ing this is certainly not desirable, therefore some
effort has been put into reducing staircasing while
preserving robustness, mostly by including the
higher-order derivatives (see e.g. [CL97, Sch98,
CMM00, LT06, BKP10]). It should also be noted
that the robustness can be increased even more at
the cost of convexity [Nik].
2.4. Linear– TV: Scalar Case
Upon closer inspection there are applications
where staircasing – or more specifically piecewise
constancy – is exactly what is desired for the out-
put. This was noted in [CEN06] for the case of geo-
metry denoising: Here the goal is to find, for some
given set T , a set S that minimizes
),(|:=|)( SPerSTSf (14)
46 УСиМ, 2011, № 2
where |)\()\(|:=| | TSSTST is the volume
of the symmetric difference of the sets T and S,
and Per(S) is the perimeter of S, Per(S) := TV(1S),
which coincides with the classical length resp. area
of the boundary if S is sufficiently smooth. Setting
Su 1:= and relaxing )(xu to the whole of R, we
arrive at the problem of minimizing
2( ) = | 1 | ,Tf u u dx Du
(15)
over )(BVu , which is a TVL 1 denoising pro-
blem as in (13) with TI 1= . The important aspect
is that we departed from the requirement that u
must be an indicator function, allowing intermedi-
ate values. This leads to an overall convex prob-
lem (15) which can be solved globally optimal;
however it introduces the possibility that we may
obtain non-discrete solutions, which do not corre-
spond to an indicator function.
In this case it is very desirable that the mini-
mizer is piecewise constant. Ideally it should be a
discrete solution, i.e. take only the values 0 or 1.
In fact this is often observed in practice. More-
over, in [CEN06] it was noted that any non-
discrete solution may be turned into a discrete one
by a simple thresholding (i.e. rounding) of u. This
allows to solve combinatorial problems globally
optimal by solving convex problems and post-
processing the solutions obtained.
This thresholding property applies to the much
wider class «Linear-TV» problems
2( ) = ( ) ( ) ,f u u x s x dx Du
(16)
with the constraint u BV(). As shown in [CEN06],
this allows to solve the Chan-Vese two-class im-
age segmentation problem [CV01]. Here the de-
sired image is piecewise constant, taking only one
of two grey values, 0c or 1c . Each point in the im-
age should be assigned either to the foreground
( 1=)(xu ) or the background ( 0=)(xu ), such that
2
1
2
0 2
( ) = ( )
(1 ) ( )
f u u c I x dx
u c I x dx Du
(17)
is minimized over all indicator functions u BV().
For fixed 1 2,c c , this is equivalent to a problem
of the form (16) for s = (c1 – I (x))2 – (c0 – I (x))2.
In a sense, the problem (16) extends the con-
cept of graph cut-based segmentation – formu-
lated on a finite set of points in the image domain,
typically a uniform grid – to continuous image
domains. Therefore it is also referred to as a con-
tinuous cut . For an extensive analysis of a closely
related problem and its associated dual problem
we refer to [Str83].
An important property is that solutions of the
ROF and L1 – TV problems (12), (13) for scalar-
valued u are intimately connected with solutions
of associated continuous cut problems of the form
(16). This comes from the fact that the scalar total
variation can be written in terms of it level sets,
.)(1=)( }>)(|{
dTVuTV xux (18)
This coarea formula [FR60] intuitively con-
nects the problem of finding Ru : with a se-
ries of problems of finding indicator functions for
problems of the type (16), and can be exploited in
two directions: On the one hand, it allows to solve
a family of parametrized continuous cut problems
by solving a single ROF-type problem and thresh-
olding [CD09, Ber09, SKO09]. On the other hand,
ROF- and L1 – TV type problems can be solved by
solving a series of continuous cuts to find the su-
per-level sets }>)(|{ xux for all , and
from these reconstructing u [Hoc01, DS06a,
DS06b, GY07, CD09, DAG09].
While in theory this would require to solve in-
finitely many problems, in practice the range of va-
lues of u is often quantized, such as {0, 1, …, 256}
for greyscale images. Under a suitable discretiza-
tion that respects the coarea formula [CD09], it is
possible to apply the same results to find the quan-
tized u – originally a combinatorial problem – by
solving a finite number of continuous cuts, or
even graph cuts [DS06a, DS06b, DAG09].
2.5. Linear TV : Multiclass Labeling
The results from the previous section do not
transfer to the case of vector-valued u, as there is
no natural extension of the coarea formula (18)
and of the thresholding process to more than two
classes. However it is still interesting to consider
the extension of (16) to vector-valued u,
2( ) = ( ), ( ) .f u u x s x dx Du
(19)
УСиМ, 2011, № 2 47
This problem class naturally occurs in relaxa-
tions of multi-class image labeling problems .
Here the goal is to find, for each pixel x in the im-
age domain d , a label },{1,)( lx which
assigns one of l class labels to x so that the labe-
ling function adheres to some data fidelity and
spatial coherency constraints. In contrast to the ima-
ge restoration applications above, u must assume
one of a finite number of values at each point.
Several authors [ZGFN08, CCP08, LKY+09]
independently proposed linearization techniques
for this problem; the basic idea is also equivalent
to the basis-function technique in [LLT06], and is
a continuous counterpart to solving combinatorial
finite-dimensional problems using LP relaxation
[KT99].
We follow the notation used in [ZGFN08, LKY+
+09]: Identify label i with the i-th unit vector
i le , set },,{:= 1 leeE , and find Eu :
minimizing
2( ) = ( ), ( ) .f u u x s x dx Du
(20)
The data term assigns to each label u(x) = e
i a
local cost )(xsi . If one constrains lBVu )( ,
the right-hand side is well-defined even though u
is not necessarily differentiable, and represents the
total weighted length of interfaces between re-
gions of constant labeling. As the data term is lin-
ear, the local costs s may be arbitrarily complex
without affecting the overall problem class.
To tackle the combinatorial nature of (20), the
problem is relaxed,
2( ), ( ) ,inf
u
u x s x dx Du
(21)
where 1}=)(0,)(|)({:=
1=
xuxuBVu i
l
ii
l
is a convex set which constrains each )(xu to the
unit simplex, i.e. to the convex hull of E. Since the
regularizer is still convex, the overall problem is
as well. On the other hand, due to the relaxation
artificial non-discrete solutions with u(x) E at
some points may be introduced.
As the data term was linearized, the local costs
s may be arbitrarily complex, possibly derived
from a probabilistic model, without losing con-
vexity. Thus the important question is what effects
can be achieved by modifying the regularizer. In
the scope of this paper, we will consider ap-
proaches where the regularizer is replaced by
( ) := ( ),J u Du
(22)
0where : l d
is continuous, convex, po-
sitively homogeneous, i.e. )(=)( zccz for
0>c , and satisfies u z
2
( ) lz z for
some 0>lu . In the TVLinear case, exis-
tence of a solution for the problem
,)()(),(inf Dudxxsxu
u
(23)
follows from [AFP00, LS10].
Although we mainly motivated the use of mo-
dified regularizer in the labeling framework, they
are as well interesting for ROF- and 1LTV type
problems (12), (13) applied to vector-valued data.
3. Total Variation-Based Regularizers
We will first review some basic properties of
the custom regularizer (22). For the proofs and
details we refer to [LS10].
3.1. Basic Properties
A structure of the regularizer. Consider the
effect of the regularizer (22) on labeling functions
u that takes only two discrete values, ie and je
for some },{1,, lji , i.e. S
j
S
i eeu \11= for
some S with <)(SPer . Then by [AFP00,
Thm. 3.84] (a variant of this was also shown in
[LS10, Prop. 4]),
1
\( 1 1 ) = ,i j i j d
S S SS
J e e e e d
(24)
where S denotes the reduced boundary of
S, and 1: d
S SS is the generalized inner
normal of S [AFP00, Def. 3.54].
Therefore the regularizer locally penalizes
jumps along the (reduced) boundary of S depend-
ing on the normal at each point, and on the labels
of the adjoining regions.
Isotropy
Often, the regularizer is assumed to be rotation
invariant ( isotropic ):
)()(=)( dSORzRz (25)
This is obviously the case if and only if
)(=)( 1 xex for any 1 dS . If is iso-
48 УСиМ, 2011, № 2
tropic, for the application of multiclass labeling
we may define the interaction potential
.:=),( 1
ji eeejid (26)
Due to the isotropy, we have =)(1 ji eee
)((=))(= 11 ijji eeeeee , therefore
d(i, j) = d(j, i). From convexity and positive ho-
mogeneity it follows that d must be subadditive,
and from the lower bound l we get that d(i, j) =
= 0 i = j.
Hence for isotropic regularizers, the interaction
potential d must be a metric, and defines the be-
havior on label functions taking only discrete label
values (e1, , el) in the spirit of (24) by
\
1
( 1 1 ) =
( , ) = ( , )Per( ),
i j
S S
d
S
J e e
d i j d d i j S
(27)
i.e. boundaries between regions of constant label-
ing are penalized by their length, weighted by
d(i, j) depending on the labels i, j of the adjoining
regions.
Permutation Invariance. This refers to the in-
variance of the regularizer with respect to permu-
tations of the elements of u, i.e. of the label set in
multiclass labeling. In terms of , invariance is
given if (z) = (zP) for any permutation matrix
l lP .
Separability. If can be written as a sum of
terms that depend only on individual components
or directional derivatives of u, it is called separa-
ble in the components of u resp. in space. Separa-
bility usually simplifies optimization, as it reduces
the coupling between variables.
Homogeneity. In (21) we assume spatial ho-
mogeneity (translation invariance), as does not
depend on x. It is also possible to consider general
non-homogeneous regularizers of the form
).(Dux (28)
This is a common practice for anisotropic in
combination with a process where the anisotropy
is controlled by local properties of the input or the
current iterate. An even more general regulariza-
tion approach is
),,,( Duuxg (29)
however this considerably complicates the re-
quirements for the existence of solutions [AFP00,
Chap. 5], and is out of scope for this paper.
Dual Formulation. In analogy to the dual defi-
nition for the total variation, for any continuous,
positively homogeneous and convex it is pos-
sible to give a dual definition: By Fenchel duality,
is the support function of some closed convex
set loc d l [RW04],
.,sup=)(=)(
yzzz
locyloc
(30)
Then, in analogy to the dual formulation of the
total variation,
},|,{sup=)( vdxDivvuuJ (31)
}.)(|)({:= xxvCv loc
ld
c (32)
Thus can be defined implicitly by its dual
set loc . This representation is also convenient for
dual or primal-dual optimization methods [Cha05,
ZGFN08, CCP08, LBS10, LS10].
3.2. Isotropic Approaches
3.2.1. Frobenius Norm
The most classical choice for is the Froben-
ius norm,
.:=)(
2
1
2
,
j
i
ji
F uDDu (33)
This definition is the basis for large parts of
geometric measure theory and the theory of func-
tions of bounded variation [AFP00], and is some-
times referred to as MTV in the context of denois-
ing of vector-valued data [SR96, DAV08]. It is
isotropic and permutation invariant, however it is
neither separable in the components of u nor in
space. The dual set F
loc is just the 2 unit ball in
d l . The associated potential is
1/ 2 = 1 =: ( , ).i j
i j ue e d i j
(34)
The potential ud on the right-hand side is known
as uniform, discrete, or Potts metric, and widely
used in approaches defined on finite grids [KT99,
BVZ01, KT07]. Optimization approaches for more
involved discretizations can be found in [LLT06,
LKY+09].
УСиМ, 2011, № 2 49
3.2.2. Linear Transformations
A straightforward modification that can be
applied to most is to introduce a matrix
1= | | l k lA a a for some lk , and define
.=))((:=)(,
ADuAuDDu FFAF (35)
This corresponds to substituting the Frobenius
matrix norm on the distributional gradient with a
linearly weighted variant. While we only consider
the Frobenius norm here, the approach can in
principle be used to augment all other norms. It
retains isotropy of the underlying norm, but nei-
ther permutation invariance nor separability.
Applied to a jump from label i to label j, this
results in the potential
, 2= =: ( , )i j i j
F A Ae e a a d i j .(36)
As noted in [LBS09], metrics of the form Ad
are known as Euclidean metrics. This class com-
prises some important special cases:
the uniform metric, with IA )2(1/= ;
the linear (label) metric, ||=),( jicjid , with
),,,2(= lcccA . This regularizer is suitable to pro-
blems where the labels can be naturally ordered,
e.g. the depth from stereo or grayscale image de-
noising.
More generally, if label i corresponds to a
prototypical vector zi in k-dimensional feature
space, and the Euclidean norm is an appropriate
metric on the features, it is natural to set
( , ) = i jd i j z z , which is Euclidean by con-
struction. This corresponds to a regularization in
feature space, rather than in «label space».
Also, non-Euclidean metrics such as the trun-
cated linear metric, |}|{2,min=),( jijid , can
be approximated by solving a (convex) SDP prob-
lem, cf. [LS10] and the references therein.
One major advantage of this kind of modifica-
tion is that it is quite powerful, but retains a clo-
sed-form expression for the regularizer. The dual
set is just A= F
loc
A
loc . Alternatively, it is often
easier to formally merge A into the linear gradient
operator Du, which allows to keep the structure of
the dual set and requires only few modifications to
the optimization method [LKY+09].
3.2.3. Channel-By-Channel
Maybe the most straightforward approach to
transfer from scalar total variation to the vector-
valued case is to sum up the total variations of the
components, i.e.
1 1 2 2( ) := .lDu Du Du (37)
In this formulation, the objective is separable in
the components of u, which potentially simplifies
numerical optimization [Blo98, ZGFN08]. For
unconstrained u, a variant of the coarea formula
(18) still holds, i.e.
1 1 >( ) = ( ) , :=1 .ui i
Du Dw d w
(38)
However for labeling problems, where one is
looking for 1: = { , , }lu E e e , this is of very
limited interest, since Exw )( in general.
Similar to the Frobenius norm, 1 implements
the uniform metric,
11/ 2 = ( , ),i j
ue e d i j (39)
and is isotropic, with 2
11 |)||{(= il
loc zzz
}},{1,1 li . As in the case of the Frobenius
norm, linearly transformed variants of the form
AuDDuA 11, := (40)
could be used. A straightforward transformation
shows that 1, 1= i j
A a a . The class of metrics
covered by this approach would thus again be
those representable using a linear embedding into
a space that is now endowed with the norm given
by 1 instead of the Euclidean norm.
3.2.4. Convex Envelope Approach
Motivated by [ABDM01], Chambolle et al.
[CCP08] proposed an approach for constructing
regularizers for multiclass labeling problems,
where the potential d is given in advance as
|)(|=),( jijid for a positive concave function
. While they used a different notation for the pa-
rametrization of the unit simplex through u, their
parametrization is equivalent to (20) under a linear
transformation of the components of u.
The approach is derived by setting
.,
,)(=,||
:=)(
otherwise
eezji
z
ji
(41)
50 УСиМ, 2011, № 2
Then is constructed as the convex envelope
of , i.e. the largest convex function smaller or
equal to . This potentially generates that are
as large as possible while still satisfying (27) for
the given d, and thus we may hope that the relaxa-
tion to the unit simplex (21) does not generate too
many artificial non-discrete solutions. This leads to
loc 1:= { = , , l
i j
v v v
2 ( ), = 0}.d l i jv v i j e v (42)
The approach can be extended to arbitrary met-
rics d by setting [LS10]
d
loc 1:= { = , , l
i j
v v v
2 ( , ), = 0}d l i jv v d i j e v (43)
for some given interface potential ),( jid . By
definition, d
loc and thus d
loc
d
= are isotropic.
In [LS10] it was shown that, for metrics d, the re-
sulting d satisfies the desired
).,(=))(( jidee ji
d (44)
This provides an approach to construct regular-
izers with arbitrary (metric) prescribed interaction
potentials d. The downside is that there is no sim-
ple closed expression for and thus for the regu-
larizer, and the dual set can be quite involved,
which potentially complicates optimization.
From (44) it can be seen that d is permuta-
tion invariant only for 0,= udd . Also note
that in order to define d, d does not have to be a
metric. However (44) then only holds as an ine-
quality, so J is not a true extension of the desired
regularizer.
3.2.5. Eigenvalue-Based Norms
In the anisotropic diffusion community it is
widely used practice ([SR96], see also [WS01]
and the references therein) to employ weighted
norms based on the eigenvalues 01 d of
the structure tensor
.=)( DuDuDuG (45)
Let ),,(:=)( 22
1
2
dDu , i.e. the i represent
the magnitudes of the singular values of Du.
While originally rooted in a diffusion framework,
the approach can also be used to construct TV-like
regularizers. It includes the Frobenius norm, since
.)(=)( 2 DueDuF (46)
In addition, for some rotation matrix ddRR
and permutation matrix llRP ,
,)(
=)(=)((
RDuRG
RDuPPDuRPDuRG
(47)
therefore 2 2( ) = ( )Du R Du P , i.e. all norms
derived from these singular values are isotropic
and permutation invariant.
The Frobenius norm approach was considered for
color denoising in [Blo98]. They observed that, since
2 1/2( ) := ,F i
i
Du Du
(48)
the Frobenius norm prefers transitions with similar
magnitude in all channels: The transition (0,0)
(1,1) is assigned a much lower penalty than the
two consecutive transitions (0,0)(1,0)(0,1).
This phenomenon does not occur with the Chan-
nel-by-Channel regularizer 1. For color denoi-
sing, this leads to a color smearing effect at edges
and a color shift towards the greyscale image
[Blo98]. A similar effect was observed in [CCP08]
for multiclass segmentation, where the preference
towards similar gradients leads to minimizers that
assume non-discrete values more frequently than
is the case for e.g. d .
In [GC10a] it was proposed to employ
,)(:=)( 2
12 GDu (49)
which amounts to the standard 2 operator norm
on Du. The corresponding dual set can be repre-
sented as
2
2 2= { | , , 1, 1}.d l
loc x R x R x (50)
While this more difficult to handle numerically
than e.g. F
loc , it can be dealt with reasonably well
in primal-dual methods, and experimentally re-
duces color smearing and channel coupling in de-
noising, deblurring and superresolution applica-
tions [GC10a]. Regarding labeling approaches, we
have
21/ 2 = ( , ),i j
ue e d i j (51)
УСиМ, 2011, № 2 51
i.e. 2 represents the uniform metric. However,
since F 2 , for multiclass labeling the energy
when using 2 potentially generates more unde-
sired minima than the standard choice F .
3.3. Anisotropic Approaches
In this section we will consider approaches that
are not rotation invariant. Note that most of these
have been developed for scalar-valued total varia-
tion; however they extend to the vector-valued
case in a straightforward manner and could be
coupled with any of the above approaches for
weighting different labels.
3.3.1. Wulff Shapes
For scalar-valued u, the use of anisotropic vari-
ants of the total variation has been studied in
[EO04] for the ROF model, where the authors
characterize minimizers of such functionals. They
base their analysis on the «Wulff shape» associ-
ated with , which is identical to loc for the sca-
lar-valued case. As an example, consider setting
db
loc [0,1]:= . Then, for (scalar!) )(BVu ,
1
1( ) = =| | | | .d
b Du Du D u D u (52)
Essentially, the Wulff shape defines the norm
via the unit ball of its dual norm. It can be
shown that the structure of loc is reflected in the
structure of the minimizer of the ROF functional
(12) in the sense that it does not affect structures
in the shape of loc itself: For small enough,
the minimizer u u of
21
( ) = 1 ( )
2 loc
f u u Du
(53)
is just a multiple of the input, i.e.
loc
cu 1=
[EO04, Thm. 4.1]. Applied to the above definition
for b , this means that the unit box may occur as
the minimizer of the anisotropic ROF model, which
cannot happen for the standard ROF model [Mey01].
Based on these results, it was shown in [ZNF09]
that the thresholding property for isotropic con-
tinuous cuts can be transferred to their anisotropic
counterparts, i.e. it is still possible to recover dis-
crete solutions of the anisotropic continuous cut
problems by thresholding. When combined with a
spatially varying, edge-driven adaptation of the
Wulff shape, they observed improved visual qual-
ity when applied to the reconstruction of depth
maps and 3D structure.
These anisotropies can also be extended to the
vector-valued case, e.g. by setting
,)(=)(
2
ib
i
DuDu (54)
or by replacing 2 by b in (43). However as in
the isotropic case this invalidates the thresholding
property.
3.3.2. Anisotropy from Discretization:
4-neighborhoods
A large class of anisotropies that occurs in
practice are actually induced by the discretization
used to approximate the total variation on grids. A
very common scheme is to add the total variation
of the individual components,
1
, ( ) := .d
a Du D u D u (55)
Here refers to some norm on l , notable ca-
ses include 2 and the completely separable case
.||=
:=)(:=)(
1=1=
1
1
1
1,,1
j
i
l
j
d
i
d
aa
uDuD
uDDuDu
(56)
This is in fact the anisotropy that is implicitly
assumed by many algorithms that use a grid-based
representation with pairwise potentials [KT99,
BVZ01, KT07]: Assume that = (0,1)2, N N
and h := 1/N, and u is discretized by its values on
the uniform grid {xi,j = (ih, jh) i, j {0, , N}}.
The usual 4-neighborhood discretization then
amounts to (with appropriate boundary conditions)
approximating the directional derivatives via
1 , 1, ,
2 , , 1 ,
1
( ) ,
1
( ) .
i j i j i j
i j i j i j
D u x u x u x
h
D u x u x u x
h
(57)
In the case of scalar-valued u (or for the indi-
vidual terms in ,1a ), the total variation with
Neumann boundary conditions is then discretized as
1
1, ,
, =0
1
( )
N
i j i j
i j
J u u x u x
h
52 УСиМ, 2011, № 2
+
1
, 1 ,
, =0
1
.
N
i j i j
i j
u x u x
h
(58)
This type of energy is tremendously popular as
it is convex, contains only pairwise terms (i.e.
terms depending on only two different variables)
and is therefore easy to implement and analyze.
Moreover, for two-class problems (resp. scalar-
valued u ), the energy has the thresholding prop-
erty and is submodular, which allows to find a
discrete solution in polynomial time, for example
using graph-cut methods [BVZ01].
For infinitesimal grid size, it implements the
,1a norm. The main drawback is that edges par-
allel to the coordinate axes are preferred to diago-
nal edges, which often leads to «zig-zag» artifacts
on diagonal structures.
3.3.3. The anisotropy from Discretization:
Larger Neighborhoods
To some extent, the discretization-induced ani-
sotropy can be reduced by increasing the neigh-
borhood, i.e. by increasing the number of pairwise
terms and adding proper weighting factors. In
[Boy03, KB05] it was shown that anisotropies
formulated as a certain class of metrics can asym-
ptotically be approximated arbitrarily well using
pairwise terms. However this requires the grid spa-
cing and the neighborhood size to approach zero
and infinity, respectively: For discretizations with
a fixed number of neighbors, true isotropy cannot
be guaranteed even for an arbitrarily fine grid.
In practice, increasing the neighborhood size
generally reduces artifacts but increases runtime.
This effect is even more pronounced in higher-
dimensional data [KSK+08].
3.4. Other Approaches
3.4.1. Color TV
For the restoration of multichannel data such as
color images [Blo98] suggests to use
.)(=)(
1/2
2
1=
i
l
i
uTVuJ (59)
While this approach is fully isotropic and per-
mutation invariant, and seems to improve ROF
restoration of images with large intensity devia-
tion between color channels, it cannot be repre-
sented in the form (22) using . Moreover, it has
the distinct disadvantage that it lacks locality, com-
pletely coupling all points in the image. While this
problem is less severe when using PDE-based
schemes for optimization, it becomes a larger im-
pediment when applying more advanced schemes
that rely on some form of sparsity.
3.4.2. The lifting of nonconvex problems
In [ABDM01, CCP08, PCBC09] a technique
was developed to minimize general variational
functionals of the form
,),,(:=)( dxuuxhuf (60)
over )(1,1 Wu , where f is convex in u , but
not necessarily in u . The approach relies on the
same approach as applied in [Ish03] in the graph
cut framework, essentially lifting the problem
originally formulated on dR to a higher-
dimensional domain 1 dR . It was shown that
, {( , ) | ( ) }
( ) = 1 ,h x dx t u x t
f u D
(61)
where xh
loc
xh ,, :=
is defined implicitly via the
Legendre-Fenchel conjugate of h with respect to
the last argument:
)}.,,(|),(:=, vtxhwRRwv dxh
loc
(62)
Essentially, this transforms the problem of
finding the optimal u into the problem of finding
the set of points below its graph, which can be
seen as a two-class segmentation problem in 1d .
This can be solved by a relaxation technique ap-
plied to (61). The problem can thus be treated as a
highly anisotropic segmentation problem.
3.4.3. Partially separable norms
For linearizations of labeling problems that in-
volve a large number of labels at each point, op-
timization can be made more efficient by exploit-
ing separability in the regularizer. This occurs for
example in optical flow estimation, where the
two-dimensional flow vectors ),(= 21 uuu at each
point are quantized using M2 labels, which re-
quires a prohibitively large amount of memory for
fine quantizations.
If the regularizer decomposes with respect to
1u and 2u , i.e. )()(=)( 2211 uJuJuJ , it is possi-
ble to apply the relaxation technique in [GC10b],
УСиМ, 2011, № 2 53
which only requires memory in the order of
)(2MO as opposed to O(M2).
4. Conclusion
In this paper, we tried to give an overview over
recent variational methods that make use of the
unique properties of total variation-based regular-
izers. These range from traditional restoration ap-
proaches to recent advanced in relaxation tech-
niques for approximately solving combinatorial pro-
blems using convex optimization.
For all these approaches, it is essential to cho-
ose a suitable norm when constructing the regula-
rizer. We hope that this overview will prove use-
ful as a reference and for weighing the advantages
and disadvantages of the numerous variants that
have been proposed.
1. [ABDM01] Alberti G., Bouchitté G., Dal Maso G. The
calibration method for the Mumford-Shah functional
and free-discontinuity problems. Technical Report math/
0105013v1, arXiv, 2001.
2. [AFP00] Ambrosio L., Fusco N., Pallara D. Functions
of Bounded Variation and Free Discontinuity Prob-
lems. Clarendon Press, 2000.
3. [AMT91] Ambrosio L., Mortola S., Tortorelli V.M. Func-
tionals with linear growth defined on vector valued BV
functions // J. Math. pures et appl., 70:193–323, 1991.
4. [Ber09] Berkels B. An unconstrained multiphase thre-
sholding approach for image segmentation // Scale Space
and Var. Meth. in Comp. Vis., 5567 of Springer LNCS. –
2009. – P. 26–37.
5. [BKP10] Bredies K., Kunisch K., Pock T. Total gener-
alized variation // SIAM J. Imaging Sci. – 2010. –
N 3(3). – P. 294–526.
6. [Blo98] Blomgren P.V. Total Variation Methods for
Restoration of Vector Valued Images. PhD thesis,
UCLA, 1998.
7. [Boy03] Boykov Y. Computing geodesics and minimal
surfaces via graph cuts // Int. Conf. Comp. Vis. – 2003. –
P. 26–33.
8. [BVZ01] Boykov Yu., Veksler O., Zabih R. Fast appro-
ximate energy minimization via graph cuts // Patt. Anal.
Mach. Intell. – 2001. – N 23(11). – P. 1222–1239.
9. [CCP08] Chambolle A., Cremers D., Pock T. A con-
vex approach for computing minimal partitions. Tech.
Rep. 649, Ecole Polytechnique CMAP, 2008.
10. [CD09] Chambolle A., Darbon J. On total variation
minimization and surface evolution using parametric
maximum flows // Int. J. Comp. Vis. // – 2009. – 84. –
P. 288–307.
11. [CEN06] Chan T.F., .,SlugEsedo Nikolova M. Algo-
rithms for finding global minimizers of image segmen-
tation and denoising models // J. Appl. Math. – 2006. –
66(5). – P. 1632–1648.
12. [Cha05] Chambolle A. Total variation minimization
and a class of binary MRF models // EMMCVPR. –
2005. – 3757. – P. 136–152.
13. [CL97] Chambolle A., Lions P.-L. Image recovery via
total variation minimization and related problems // Nu-
mer. Math. – 1997. – 76(2). – P. 167–188.
14. [CMM00] Chan T., Marquina A., Mulet P. Higher-order
total variation-based image restoration // J. Sci. Com-
put. – 2000. – 22(2). – P. 503–516.
15. [CV01] Chan T.F., Vese L.A. Active contours without
edges // IEEE Trans. Image Proc. – 2001. – 10(2). –
P. 266–277.
16. [DAG09] Duval V., Aujol J.-F., Gousseau Y. The TVL1
model: a geometric point of view // Technical Report
00380195, HAL, 2009.
17. [DAV08] Duval V., Aujol J.-F., Vese L. A projected gra-
dient algorithm for color image decomposition // CMLA
Preprint, (2008–21), 2008.
18. [DS06a] Darbon J., Sigelle M. Image restoration with
discrete constrained total variation part I: Fast and ex-
act optimization // J. Math. Imaging Vis. – 2006. –
26(3). – P. 261–276.
19. [DS06b] Darbon J., Sigelle M. Image restoration with
discrete constrained total variation part II: Levelable fun-
ctions, convex priors and non-convex cases // Ibid. –
P. 277–291.
20. [EO04] .,SlugEsedo Osher S.J. Decomposition of ima-
ges by the anisotropic Rudin-Osher-Fatemi model //
Comm. Pure Appl. Math. – 2004. – 57. – P. 1609–1626.
21. [FR60] Fleming W.H., Rishel R. An integral formula
for total gradient variation // Archiv der Mathematik. –
1960. – 11(1). – P. 218–222.
22. [GC10a] Goldluecke B., Cremers D. An approach to
vectorial total variation based on geometric measure
theory // Conf. Comp. Vis. Patt. Recog., 2010.
23. [GC10b] Goldluecke S., Cremers D. Convex relaxa-
tion for multilabel problems with product label spaces
// Europ. Conf. Comp. Vis., 2010.
24. [GY07] Goldfarb D., Yin Y. Parametric maximum flow
algorithms for fast total variation minimization. CAAM
tech. rep., Rice Univ., 2007.
25. [Hoc01] Hochbaum D. An efficient algorithm for im-
age segmentation, Markov random fields and related
problems // J. of the ACM. –2001. – 48.
26. [Ish03] Ishikawa H.. Exact optimization for Markov
random fields with convex priors // Patt. Anal. Mach.
Intell.. – 2003. – 25(10). – P. 1333–1336.
27. [KB05] Kolmogorov V., Boykov Y. What metrics can
be approximated by geo-cuts, or global optimization of
length/area and flux // Int. Conf. Comp. Vis. –2005. –
N 1. – P. 564–571.
28. [KSK+08] Klodt M., Schoenemann T., Kolev K. et al.
An experimental comparison of discrete and continu-
54 УСиМ, 2011, № 2
ous shape optimization methods // Europ. Conf. Comp.
Vis., Marseille, France, Oct. 2008.
29. [KT99] Kleinberg J.M., Tardos E. Approximation algo-
rithms for classification problems with pairwise rela-
tionships: Metric labeling and Markov random fields
// Found. Comp. Sci. –1999. – P. 14–23.
30. [KT07] Komodakis N., Tziritas G. Approximate label-
ing via graph cuts based on linear programming // Patt.
Anal. Mach. Intell. – 2007. – 29(8). – P. 1436–1453.
31. [LBS09] Lellmann J., Becker F., Schnörr C. Convex
optimization for multi-class image labeling with a novel
family of total variation based regularizers // Int. Conf.
Comp. Vis., 2009.
32. [LBS10] Lellmann J., Breitenreicher D., Schnörr C.
Fast and exact primal-dual iterations for variational
problems in computer vision // Europ. Conf. Comp.
Vis. – 2010. – 6312 of LNCS. – P. 494–505.
33. [LKY+09] Convex multi-class image labeling by sim-
plex-constrained total variation / J. Lellmann, J. Kap-
pes, J. Yuanet al. // Scale Space and Var. Meth. –
2009. – 5567 of LNCS. – P. 150–162.
34. [LLT06] Lie J., Lysaker M., Tai X.-C. A variant of the
level set method and applications to image segmenta-
tion // Math. Comp. – 2006. – 75. – P. 1155–1174.
35. [LS10] Lellmann J., Schnörr C. Continuous multiclass
labeling approaches and algorithms // Tech. rep., Univ.
of Heidelberg, Feb. 2010.
36. [LT06] Lysaker M., Tai X.-C. Iterative image restora-
tion combining total variation minimization and a sec-
ond-order functional // Int. J. Comp. Vis. – 2006. –
66(1). – P. 5–18.
37. [Mey01] Meyer Y. Oscillating Patterns in Image Proc-
essing and Nonlinear Evolution Equations, 22 of Univ.
Lect. Series. AMS, 2001.
38. [Nik] Nikolova M. Functionals for signal and image
reconstruction: properties of their minimizers and ap-
plications. CMLA research report, ENS de Cachan.
39. [Nik01] Nikolova M. Smoothing of outliers in image
restoration by minimizing regularized objective func-
tions with nonsmooth data-fidelity terms // Int. Conf.
Image Proc. – 2001. – 1. – P. 233–236.
40. [PCBC09] Global solutions of variational models with
convex regularization / T. Pock, D. Cremers, H. Bischof
et al., Technical report, Graz Univ. of Tech., 2009. Pre-
print.
41. [ROF92] Rudin L., Osher S., Fatemi E. Nonlinear total
variation based noise removal algorithms // Physica D. –
1992. – 60. – P. 259–268.
42. [RW04] Rockafellar R.T., Wets R.J.-B. Variational Ana-
lysis. Springer, 2004.
43. [Sch98] Scherzer O. Denoising with higher order de-
rivatives of bounded variation and an application to pa-
rameter estimation // Computing. – 1998. – 60. – P. 1–27.
44. [SGG+09] Scherzer O., Grasmair M., Grossauer H., Halt-
meier M., Lenzen F. Variational Methods in Imaging. –
167 of Applied Mathematical Sciences. Springer, 2009.
45. [SKO09] Strandmark P., Kahl F., Overgaard N.C. Opti-
mizing parametric total variation models // Int. Conf.
Comp. Vis. – 2009.
46. [SR96] Sapiro G., Ringach D.L. Anisotropic diffusion of
multivalued images with applications to color filtering
// IEEE Trans. Image Proc. – 1996. – 5(11). – P. 1582–
1586.
47. [Str83] Strang G. Maximal flow through a domain
// Math. Prog. – 1983. – 26. – P. 123–143.
48. [WS01] Weickert J., Schnörr C. A theoretical frame-
work for convex regularizers in PDE-based computa-
tion of image motion // Int. J. Comp. Vis. – 2002. –
45(3). – P. 245–264.
49. [ZGFN08] Fast global labeling for real-time stereo using
multiple plane sweeps / C. Zach, D. Gallup, J. Frahm
et al. // Vis. Mod. Vis, 2008.
50. [ZNF09] Zach C., Niethammer M., Frahm J.-M. Con-
tinuous maximal flows and Wulff shapes: Application
to MRFs // Comp. Vis. Patt. Recogn. – 2009. – P. 1911–
1918.
© J. Lellmann, C. Schnörr, Image and Pattern Analysis Group & HCI,
University of Heideberg, 2011
<<
/ASCII85EncodePages false
/AllowTransparency false
/AutoPositionEPSFiles true
/AutoRotatePages /None
/Binding /Left
/CalGrayProfile (Dot Gain 20%)
/CalRGBProfile (sRGB IEC61966-2.1)
/CalCMYKProfile (U.S. Web Coated \050SWOP\051 v2)
/sRGBProfile (sRGB IEC61966-2.1)
/CannotEmbedFontPolicy /Error
/CompatibilityLevel 1.4
/CompressObjects /Tags
/CompressPages true
/ConvertImagesToIndexed true
/PassThroughJPEGImages true
/CreateJobTicket false
/DefaultRenderingIntent /Default
/DetectBlends true
/DetectCurves 0.0000
/ColorConversionStrategy /CMYK
/DoThumbnails false
/EmbedAllFonts true
/EmbedOpenType false
/ParseICCProfilesInComments true
/EmbedJobOptions true
/DSCReportingLevel 0
/EmitDSCWarnings false
/EndPage -1
/ImageMemory 1048576
/LockDistillerParams false
/MaxSubsetPct 100
/Optimize true
/OPM 1
/ParseDSCComments true
/ParseDSCCommentsForDocInfo true
/PreserveCopyPage true
/PreserveDICMYKValues true
/PreserveEPSInfo true
/PreserveFlatness true
/PreserveHalftoneInfo false
/PreserveOPIComments true
/PreserveOverprintSettings true
/StartPage 1
/SubsetFonts true
/TransferFunctionInfo /Apply
/UCRandBGInfo /Preserve
/UsePrologue false
/ColorSettingsFile ()
/AlwaysEmbed [ true
]
/NeverEmbed [ true
]
/AntiAliasColorImages false
/CropColorImages true
/ColorImageMinResolution 300
/ColorImageMinResolutionPolicy /OK
/DownsampleColorImages true
/ColorImageDownsampleType /Bicubic
/ColorImageResolution 300
/ColorImageDepth -1
/ColorImageMinDownsampleDepth 1
/ColorImageDownsampleThreshold 1.50000
/EncodeColorImages true
/ColorImageFilter /DCTEncode
/AutoFilterColorImages true
/ColorImageAutoFilterStrategy /JPEG
/ColorACSImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/ColorImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/JPEG2000ColorACSImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/JPEG2000ColorImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/AntiAliasGrayImages false
/CropGrayImages true
/GrayImageMinResolution 300
/GrayImageMinResolutionPolicy /OK
/DownsampleGrayImages true
/GrayImageDownsampleType /Bicubic
/GrayImageResolution 300
/GrayImageDepth -1
/GrayImageMinDownsampleDepth 2
/GrayImageDownsampleThreshold 1.50000
/EncodeGrayImages true
/GrayImageFilter /DCTEncode
/AutoFilterGrayImages true
/GrayImageAutoFilterStrategy /JPEG
/GrayACSImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/GrayImageDict <<
/QFactor 0.15
/HSamples [1 1 1 1] /VSamples [1 1 1 1]
>>
/JPEG2000GrayACSImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/JPEG2000GrayImageDict <<
/TileWidth 256
/TileHeight 256
/Quality 30
>>
/AntiAliasMonoImages false
/CropMonoImages true
/MonoImageMinResolution 1200
/MonoImageMinResolutionPolicy /OK
/DownsampleMonoImages true
/MonoImageDownsampleType /Bicubic
/MonoImageResolution 1200
/MonoImageDepth -1
/MonoImageDownsampleThreshold 1.50000
/EncodeMonoImages true
/MonoImageFilter /CCITTFaxEncode
/MonoImageDict <<
/K -1
>>
/AllowPSXObjects false
/CheckCompliance [
/None
]
/PDFX1aCheck false
/PDFX3Check false
/PDFXCompliantPDFOnly false
/PDFXNoTrimBoxError true
/PDFXTrimBoxToMediaBoxOffset [
0.00000
0.00000
0.00000
0.00000
]
/PDFXSetBleedBoxToMediaBox true
/PDFXBleedBoxToTrimBoxOffset [
0.00000
0.00000
0.00000
0.00000
]
/PDFXOutputIntentProfile ()
/PDFXOutputConditionIdentifier ()
/PDFXOutputCondition ()
/PDFXRegistryName ()
/PDFXTrapped /False
/CreateJDFFile false
/Description <<
/ARA <FEFF06270633062A062E062F0645002006470630064700200627064406250639062F0627062F0627062A002006440625064606340627062100200648062B062706260642002000410064006F00620065002000500044004600200645062A064806270641064206290020064406440637062806270639062900200641064A00200627064406450637062706280639002006300627062A0020062F0631062C0627062A002006270644062C0648062F0629002006270644063906270644064A0629061B0020064A06450643064600200641062A062D00200648062B0627062606420020005000440046002006270644064506460634062306290020062806270633062A062E062F062706450020004100630072006F0062006100740020064800410064006F006200650020005200650061006400650072002006250635062F0627063100200035002E0030002006480627064406250635062F062706310627062A0020062706440623062D062F062B002E0635062F0627063100200035002E0030002006480627064406250635062F062706310627062A0020062706440623062D062F062B002E>
/BGR <FEFF04180437043f043e043b043704320430043904420435002004420435043704380020043d0430044104420440043e0439043a0438002c00200437043000200434043000200441044a0437043404300432043004420435002000410064006f00620065002000500044004600200434043e043a0443043c0435043d04420438002c0020043c0430043a04410438043c0430043b043d043e0020043f044004380433043e04340435043d04380020043704300020043204380441043e043a043e043a0430044704350441044204320435043d0020043f04350447043004420020043704300020043f044004350434043f0435044704300442043d04300020043f043e04340433043e0442043e0432043a0430002e002000200421044a04370434043004340435043d043804420435002000500044004600200434043e043a0443043c0435043d044204380020043c043e0433043004420020043404300020044104350020043e0442043204300440044f0442002004410020004100630072006f00620061007400200438002000410064006f00620065002000520065006100640065007200200035002e00300020043800200441043b0435043404320430044904380020043204350440044104380438002e>
/CHS <FEFF4f7f75288fd94e9b8bbe5b9a521b5efa7684002000410064006f006200650020005000440046002065876863900275284e8e9ad88d2891cf76845370524d53705237300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c676562535f00521b5efa768400200050004400460020658768633002>
/CHT <FEFF4f7f752890194e9b8a2d7f6e5efa7acb7684002000410064006f006200650020005000440046002065874ef69069752865bc9ad854c18cea76845370524d5370523786557406300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c4f86958b555f5df25efa7acb76840020005000440046002065874ef63002>
/CZE <FEFF005400610074006f0020006e006100730074006100760065006e00ed00200070006f0075017e0069006a007400650020006b0020007600790074007600e101590065006e00ed00200064006f006b0075006d0065006e0074016f002000410064006f006200650020005000440046002c0020006b00740065007200e90020007300650020006e0065006a006c00e90070006500200068006f006400ed002000700072006f0020006b00760061006c00690074006e00ed0020007400690073006b00200061002000700072006500700072006500730073002e002000200056007900740076006f01590065006e00e900200064006f006b0075006d0065006e007400790020005000440046002000620075006400650020006d006f017e006e00e90020006f007400650076015900ed007400200076002000700072006f006700720061006d0065006300680020004100630072006f00620061007400200061002000410064006f00620065002000520065006100640065007200200035002e0030002000610020006e006f0076011b006a016100ed00630068002e>
/DAN <FEFF004200720075006700200069006e0064007300740069006c006c0069006e006700650072006e0065002000740069006c0020006100740020006f007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400650072002c0020006400650072002000620065006400730074002000650067006e006500720020007300690067002000740069006c002000700072006500700072006500730073002d007500640073006b007200690076006e0069006e00670020006100660020006800f8006a0020006b00760061006c0069007400650074002e0020004400650020006f007000720065007400740065006400650020005000440046002d0064006f006b0075006d0065006e0074006500720020006b0061006e002000e50062006e00650073002000690020004100630072006f00620061007400200065006c006c006500720020004100630072006f006200610074002000520065006100640065007200200035002e00300020006f00670020006e0079006500720065002e>
/DEU <FEFF00560065007200770065006e00640065006e0020005300690065002000640069006500730065002000450069006e007300740065006c006c0075006e00670065006e0020007a0075006d002000450072007300740065006c006c0065006e00200076006f006e002000410064006f006200650020005000440046002d0044006f006b0075006d0065006e00740065006e002c00200076006f006e002000640065006e0065006e002000530069006500200068006f006300680077006500720074006900670065002000500072006500700072006500730073002d0044007200750063006b0065002000650072007a0065007500670065006e0020006d00f60063006800740065006e002e002000450072007300740065006c006c007400650020005000440046002d0044006f006b0075006d0065006e007400650020006b00f6006e006e0065006e0020006d006900740020004100630072006f00620061007400200075006e0064002000410064006f00620065002000520065006100640065007200200035002e00300020006f0064006500720020006800f600680065007200200067006500f600660066006e00650074002000770065007200640065006e002e>
/ESP <FEFF005500740069006c0069006300650020006500730074006100200063006f006e0066006900670075007200610063006900f3006e0020007000610072006100200063007200650061007200200064006f00630075006d0065006e0074006f00730020005000440046002000640065002000410064006f0062006500200061006400650063007500610064006f00730020007000610072006100200069006d0070007200650073006900f3006e0020007000720065002d0065006400690074006f007200690061006c00200064006500200061006c00740061002000630061006c0069006400610064002e002000530065002000700075006500640065006e00200061006200720069007200200064006f00630075006d0065006e0074006f00730020005000440046002000630072006500610064006f007300200063006f006e0020004100630072006f006200610074002c002000410064006f00620065002000520065006100640065007200200035002e003000200079002000760065007200730069006f006e0065007300200070006f00730074006500720069006f007200650073002e>
/ETI <FEFF004b00610073007500740061006700650020006e0065006900640020007300e4007400740065006900640020006b00760061006c006900740065006500740073006500200074007200fc006b006900650065006c007300650020007000720069006e00740069006d0069007300650020006a0061006f006b007300200073006f00620069006c0069006b0065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e00740069006400650020006c006f006f006d006900730065006b0073002e00200020004c006f006f0064007500640020005000440046002d0064006f006b0075006d0065006e00740065002000730061006100740065002000610076006100640061002000700072006f006700720061006d006d006900640065006700610020004100630072006f0062006100740020006e0069006e0067002000410064006f00620065002000520065006100640065007200200035002e00300020006a00610020007500750065006d006100740065002000760065007200730069006f006f006e00690064006500670061002e000d000a>
/FRA <FEFF005500740069006c006900730065007a00200063006500730020006f007000740069006f006e00730020006100660069006e00200064006500200063007200e900650072002000640065007300200064006f00630075006d0065006e00740073002000410064006f00620065002000500044004600200070006f0075007200200075006e00650020007100750061006c0069007400e90020006400270069006d007000720065007300730069006f006e00200070007200e9007000720065007300730065002e0020004c0065007300200064006f00630075006d0065006e00740073002000500044004600200063007200e900e90073002000700065007500760065006e0074002000ea0074007200650020006f007500760065007200740073002000640061006e00730020004100630072006f006200610074002c002000610069006e00730069002000710075002700410064006f00620065002000520065006100640065007200200035002e0030002000650074002000760065007200730069006f006e007300200075006c007400e90072006900650075007200650073002e>
/GRE <FEFF03a703c103b703c303b903bc03bf03c003bf03b903ae03c303c403b5002003b103c503c403ad03c2002003c403b903c2002003c103c503b803bc03af03c303b503b903c2002003b303b903b1002003bd03b1002003b403b703bc03b903bf03c503c103b303ae03c303b503c403b5002003ad03b303b303c103b103c603b1002000410064006f006200650020005000440046002003c003bf03c5002003b503af03bd03b103b9002003ba03b103c42019002003b503be03bf03c703ae03bd002003ba03b103c403ac03bb03bb03b703bb03b1002003b303b903b1002003c003c103bf002d03b503ba03c403c503c003c903c403b903ba03ad03c2002003b503c103b303b103c303af03b503c2002003c503c803b703bb03ae03c2002003c003bf03b903cc03c403b703c403b103c2002e0020002003a403b10020005000440046002003ad03b303b303c103b103c603b1002003c003bf03c5002003ad03c703b503c403b5002003b403b703bc03b903bf03c503c103b303ae03c303b503b9002003bc03c003bf03c103bf03cd03bd002003bd03b1002003b103bd03bf03b903c703c403bf03cd03bd002003bc03b5002003c403bf0020004100630072006f006200610074002c002003c403bf002000410064006f00620065002000520065006100640065007200200035002e0030002003ba03b103b9002003bc03b503c403b103b303b503bd03ad03c303c403b503c103b503c2002003b503ba03b403cc03c303b503b903c2002e>
/HEB <FEFF05D405E905EA05DE05E905D5002005D105D405D205D305E805D505EA002005D005DC05D4002005DB05D305D9002005DC05D905E605D505E8002005DE05E105DE05DB05D9002000410064006F006200650020005000440046002005D405DE05D505EA05D005DE05D905DD002005DC05D405D305E405E105EA002005E705D305DD002D05D305E405D505E1002005D005D905DB05D505EA05D905EA002E002005DE05E105DE05DB05D90020005000440046002005E905E005D505E605E805D5002005E005D905EA05E005D905DD002005DC05E405EA05D905D705D4002005D105D005DE05E605E205D505EA0020004100630072006F006200610074002005D5002D00410064006F00620065002000520065006100640065007200200035002E0030002005D505D205E805E105D005D505EA002005DE05EA05E705D305DE05D505EA002005D905D505EA05E8002E05D005DE05D905DD002005DC002D005000440046002F0058002D0033002C002005E205D905D905E005D5002005D105DE05D305E805D905DA002005DC05DE05E905EA05DE05E9002005E905DC0020004100630072006F006200610074002E002005DE05E105DE05DB05D90020005000440046002005E905E005D505E605E805D5002005E005D905EA05E005D905DD002005DC05E405EA05D905D705D4002005D105D005DE05E605E205D505EA0020004100630072006F006200610074002005D5002D00410064006F00620065002000520065006100640065007200200035002E0030002005D505D205E805E105D005D505EA002005DE05EA05E705D305DE05D505EA002005D905D505EA05E8002E>
/HRV (Za stvaranje Adobe PDF dokumenata najpogodnijih za visokokvalitetni ispis prije tiskanja koristite ove postavke. Stvoreni PDF dokumenti mogu se otvoriti Acrobat i Adobe Reader 5.0 i kasnijim verzijama.)
/HUN <FEFF004b0069007600e1006c00f30020006d0069006e0151007300e9006701710020006e0079006f006d00640061006900200065006c0151006b00e90073007a00ed007401510020006e0079006f006d00740061007400e100730068006f007a0020006c006500670069006e006b00e1006200620020006d0065006700660065006c0065006c0151002000410064006f00620065002000500044004600200064006f006b0075006d0065006e00740075006d006f006b0061007400200065007a0065006b006b0065006c0020006100200062006500e1006c006c00ed007400e10073006f006b006b0061006c0020006b00e90073007a00ed0074006800650074002e0020002000410020006c00e90074007200650068006f007a006f00740074002000500044004600200064006f006b0075006d0065006e00740075006d006f006b00200061007a0020004100630072006f006200610074002000e9007300200061007a002000410064006f00620065002000520065006100640065007200200035002e0030002c0020007600610067007900200061007a002000610074007400f3006c0020006b00e9007301510062006200690020007600650072007a006900f3006b006b0061006c0020006e00790069007400680061007400f3006b0020006d00650067002e>
/ITA <FEFF005500740069006c0069007a007a006100720065002000710075006500730074006500200069006d0070006f007300740061007a0069006f006e00690020007000650072002000630072006500610072006500200064006f00630075006d0065006e00740069002000410064006f00620065002000500044004600200070006900f900200061006400610074007400690020006100200075006e00610020007000720065007300740061006d0070006100200064006900200061006c007400610020007100750061006c0069007400e0002e0020004900200064006f00630075006d0065006e007400690020005000440046002000630072006500610074006900200070006f00730073006f006e006f0020006500730073006500720065002000610070006500720074006900200063006f006e0020004100630072006f00620061007400200065002000410064006f00620065002000520065006100640065007200200035002e003000200065002000760065007200730069006f006e006900200073007500630063006500730073006900760065002e>
/JPN <FEFF9ad854c18cea306a30d730ea30d730ec30b951fa529b7528002000410064006f0062006500200050004400460020658766f8306e4f5c6210306b4f7f75283057307e305930023053306e8a2d5b9a30674f5c62103055308c305f0020005000440046002030d530a130a430eb306f3001004100630072006f0062006100740020304a30883073002000410064006f00620065002000520065006100640065007200200035002e003000204ee5964d3067958b304f30533068304c3067304d307e305930023053306e8a2d5b9a306b306f30d530a930f330c8306e57cb30818fbc307f304c5fc59808306730593002>
/KOR <FEFFc7740020c124c815c7440020c0acc6a9d558c5ec0020ace0d488c9c80020c2dcd5d80020c778c1c4c5d00020ac00c7a50020c801d569d55c002000410064006f0062006500200050004400460020bb38c11cb97c0020c791c131d569b2c8b2e4002e0020c774b807ac8c0020c791c131b41c00200050004400460020bb38c11cb2940020004100630072006f0062006100740020bc0f002000410064006f00620065002000520065006100640065007200200035002e00300020c774c0c1c5d0c11c0020c5f40020c2180020c788c2b5b2c8b2e4002e>
/LTH <FEFF004e006100750064006f006b0069007400650020016100690075006f007300200070006100720061006d006500740072007500730020006e006f0072011700640061006d00690020006b0075007200740069002000410064006f00620065002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b00750072006900650020006c0061006200690061007500730069006100690020007000720069007400610069006b007900740069002000610075006b01610074006f00730020006b006f006b007900620117007300200070006100720065006e006700740069006e00690061006d00200073007000610075007300640069006e0069006d00750069002e0020002000530075006b0075007200740069002000500044004600200064006f006b0075006d0065006e007400610069002000670061006c006900200062016b007400690020006100740069006400610072006f006d00690020004100630072006f006200610074002000690072002000410064006f00620065002000520065006100640065007200200035002e0030002000610072002000760117006c00650073006e0117006d00690073002000760065007200730069006a006f006d00690073002e>
/LVI <FEFF0049007a006d0061006e0074006f006a00690065007400200161006f00730020006900650073007400610074012b006a0075006d00750073002c0020006c0061006900200076006500690064006f00740075002000410064006f00620065002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b006100730020006900720020012b00700061016100690020007000690065006d01130072006f00740069002000610075006700730074006100730020006b00760061006c0069007401010074006500730020007000690072006d007300690065007300700069006501610061006e006100730020006400720075006b00610069002e00200049007a0076006500690064006f006a006900650074002000500044004600200064006f006b0075006d0065006e007400750073002c0020006b006f002000760061007200200061007400760113007200740020006100720020004100630072006f00620061007400200075006e002000410064006f00620065002000520065006100640065007200200035002e0030002c0020006b0101002000610072012b00200074006f0020006a00610075006e0101006b0101006d002000760065007200730069006a0101006d002e>
/NLD (Gebruik deze instellingen om Adobe PDF-documenten te maken die zijn geoptimaliseerd voor prepress-afdrukken van hoge kwaliteit. De gemaakte PDF-documenten kunnen worden geopend met Acrobat en Adobe Reader 5.0 en hoger.)
/NOR <FEFF004200720075006b00200064006900730073006500200069006e006e007300740069006c006c0069006e00670065006e0065002000740069006c002000e50020006f0070007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e00740065007200200073006f006d00200065007200200062006500730074002000650067006e0065007400200066006f00720020006600f80072007400720079006b006b0073007500740073006b00720069006600740020006100760020006800f800790020006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e00650020006b0061006e002000e50070006e00650073002000690020004100630072006f00620061007400200065006c006c00650072002000410064006f00620065002000520065006100640065007200200035002e003000200065006c006c00650072002000730065006e006500720065002e>
/POL <FEFF0055007300740061007700690065006e0069006100200064006f002000740077006f0072007a0065006e0069006100200064006f006b0075006d0065006e007400f300770020005000440046002000700072007a0065007a006e00610063007a006f006e00790063006800200064006f002000770079006400720075006b00f30077002000770020007700790073006f006b00690065006a0020006a0061006b006f015b00630069002e002000200044006f006b0075006d0065006e0074007900200050004400460020006d006f017c006e00610020006f007400770069006500720061010700200077002000700072006f006700720061006d006900650020004100630072006f00620061007400200069002000410064006f00620065002000520065006100640065007200200035002e0030002000690020006e006f00770073007a0079006d002e>
/PTB <FEFF005500740069006c0069007a006500200065007300730061007300200063006f006e00660069006700750072006100e700f50065007300200064006500200066006f0072006d00610020006100200063007200690061007200200064006f00630075006d0065006e0074006f0073002000410064006f0062006500200050004400460020006d00610069007300200061006400650071007500610064006f00730020007000610072006100200070007200e9002d0069006d0070007200650073007300f50065007300200064006500200061006c007400610020007100750061006c00690064006100640065002e0020004f007300200064006f00630075006d0065006e0074006f00730020005000440046002000630072006900610064006f007300200070006f00640065006d0020007300650072002000610062006500720074006f007300200063006f006d0020006f0020004100630072006f006200610074002000650020006f002000410064006f00620065002000520065006100640065007200200035002e0030002000650020007600650072007300f50065007300200070006f00730074006500720069006f007200650073002e>
/RUM <FEFF005500740069006c0069007a00610163006900200061006300650073007400650020007300650074010300720069002000700065006e007400720075002000610020006300720065006100200064006f00630075006d0065006e00740065002000410064006f006200650020005000440046002000610064006500630076006100740065002000700065006e0074007200750020007400690070010300720069007200650061002000700072006500700072006500730073002000640065002000630061006c006900740061007400650020007300750070006500720069006f006100720103002e002000200044006f00630075006d0065006e00740065006c00650020005000440046002000630072006500610074006500200070006f00740020006600690020006400650073006300680069007300650020006300750020004100630072006f006200610074002c002000410064006f00620065002000520065006100640065007200200035002e00300020015f00690020007600650072007300690075006e0069006c006500200075006c0074006500720069006f006100720065002e>
/RUS <FEFF04180441043f043e043b044c04370443043904420435002004340430043d043d044b04350020043d0430044104420440043e0439043a043800200434043b044f00200441043e043704340430043d0438044f00200434043e043a0443043c0435043d0442043e0432002000410064006f006200650020005000440046002c0020043c0430043a04410438043c0430043b044c043d043e0020043f043e04340445043e0434044f04490438044500200434043b044f00200432044b0441043e043a043e043a0430044704350441044204320435043d043d043e0433043e00200434043e043f0435044704300442043d043e0433043e00200432044b0432043e04340430002e002000200421043e043704340430043d043d044b04350020005000440046002d0434043e043a0443043c0435043d0442044b0020043c043e0436043d043e0020043e0442043a0440044b043204300442044c002004410020043f043e043c043e0449044c044e0020004100630072006f00620061007400200438002000410064006f00620065002000520065006100640065007200200035002e00300020043800200431043e043b043504350020043f043e04370434043d043804450020043204350440044104380439002e>
/SKY <FEFF0054006900650074006f0020006e006100730074006100760065006e0069006100200070006f0075017e0069007400650020006e00610020007600790074007600e100720061006e0069006500200064006f006b0075006d0065006e0074006f0076002000410064006f006200650020005000440046002c0020006b0074006f007200e90020007300610020006e0061006a006c0065007001610069006500200068006f0064006900610020006e00610020006b00760061006c00690074006e00fa00200074006c0061010d00200061002000700072006500700072006500730073002e00200056007900740076006f00720065006e00e900200064006f006b0075006d0065006e007400790020005000440046002000620075006400650020006d006f017e006e00e90020006f00740076006f00720069016500200076002000700072006f006700720061006d006f006300680020004100630072006f00620061007400200061002000410064006f00620065002000520065006100640065007200200035002e0030002000610020006e006f0076016100ed00630068002e>
/SLV <FEFF005400650020006e006100730074006100760069007400760065002000750070006f0072006100620069007400650020007a00610020007500730074007600610072006a0061006e006a006500200064006f006b0075006d0065006e0074006f0076002000410064006f006200650020005000440046002c0020006b006900200073006f0020006e0061006a007000720069006d00650072006e0065006a016100690020007a00610020006b0061006b006f0076006f00730074006e006f0020007400690073006b0061006e006a00650020007300200070007200690070007200610076006f0020006e00610020007400690073006b002e00200020005500730074007600610072006a0065006e006500200064006f006b0075006d0065006e0074006500200050004400460020006a00650020006d006f0067006f010d00650020006f0064007000720065007400690020007a0020004100630072006f00620061007400200069006e002000410064006f00620065002000520065006100640065007200200035002e003000200069006e0020006e006f00760065006a01610069006d002e>
/SUO <FEFF004b00e40079007400e40020006e00e40069007400e4002000610073006500740075006b007300690061002c0020006b0075006e0020006c0075006f00740020006c00e400680069006e006e00e4002000760061006100740069007600610061006e0020007000610069006e006100740075006b00730065006e002000760061006c006d0069007300740065006c00750074007900f6006800f6006e00200073006f00700069007600690061002000410064006f0062006500200050004400460020002d0064006f006b0075006d0065006e007400740065006a0061002e0020004c0075006f0064007500740020005000440046002d0064006f006b0075006d0065006e00740069007400200076006f0069006400610061006e0020006100760061007400610020004100630072006f0062006100740069006c006c00610020006a0061002000410064006f00620065002000520065006100640065007200200035002e0030003a006c006c00610020006a006100200075007500640065006d006d0069006c006c0061002e>
/SVE <FEFF0041006e007600e4006e00640020006400650020006800e4007200200069006e0073007400e4006c006c006e0069006e006700610072006e00610020006f006d002000640075002000760069006c006c00200073006b006100700061002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400200073006f006d002000e400720020006c00e4006d0070006c0069006700610020006600f60072002000700072006500700072006500730073002d007500740073006b00720069006600740020006d006500640020006800f600670020006b00760061006c0069007400650074002e002000200053006b006100700061006400650020005000440046002d0064006f006b0075006d0065006e00740020006b0061006e002000f600700070006e00610073002000690020004100630072006f0062006100740020006f00630068002000410064006f00620065002000520065006100640065007200200035002e00300020006f00630068002000730065006e006100720065002e>
/TUR <FEFF005900fc006b00730065006b0020006b0061006c006900740065006c0069002000f6006e002000790061007a006401310072006d00610020006200610073006b013100730131006e006100200065006e0020006900790069002000750079006100620069006c006500630065006b002000410064006f006200650020005000440046002000620065006c00670065006c0065007200690020006f006c0075015f007400750072006d0061006b0020006900e70069006e00200062007500200061007900610072006c0061007201310020006b0075006c006c0061006e0131006e002e00200020004f006c0075015f0074007500720075006c0061006e0020005000440046002000620065006c00670065006c0065007200690020004100630072006f006200610074002000760065002000410064006f00620065002000520065006100640065007200200035002e003000200076006500200073006f006e0072006100730131006e00640061006b00690020007300fc007200fc006d006c00650072006c00650020006100e70131006c006100620069006c00690072002e>
/UKR <FEFF04120438043a043e0440043804410442043e043204430439044204350020044604560020043f043004400430043c043504420440043800200434043b044f0020044104420432043e04400435043d043d044f00200434043e043a0443043c0435043d044204560432002000410064006f006200650020005000440046002c0020044f043a04560020043d04300439043a04400430044904350020043f045604340445043e0434044f0442044c00200434043b044f0020043204380441043e043a043e044f043a04560441043d043e0433043e0020043f0435044004350434043404400443043a043e0432043e0433043e0020043404400443043a0443002e00200020042104420432043e04400435043d045600200434043e043a0443043c0435043d0442043800200050004400460020043c043e0436043d04300020043204560434043a0440043804420438002004430020004100630072006f006200610074002004420430002000410064006f00620065002000520065006100640065007200200035002e0030002004300431043e0020043f04560437043d04560448043e04570020043204350440044104560457002e>
/ENU (Use these settings to create Adobe PDF documents best suited for high-quality prepress printing. Created PDF documents can be opened with Acrobat and Adobe Reader 5.0 and later.)
>>
/Namespace [
(Adobe)
(Common)
(1.0)
]
/OtherNamespaces [
<<
/AsReaderSpreads false
/CropImagesToFrames true
/ErrorControl /WarnAndContinue
/FlattenerIgnoreSpreadOverrides false
/IncludeGuidesGrids false
/IncludeNonPrinting false
/IncludeSlug false
/Namespace [
(Adobe)
(InDesign)
(4.0)
]
/OmitPlacedBitmaps false
/OmitPlacedEPS false
/OmitPlacedPDF false
/SimulateOverprint /Legacy
>>
<<
/AddBleedMarks false
/AddColorBars false
/AddCropMarks false
/AddPageInfo false
/AddRegMarks false
/ConvertColors /ConvertToCMYK
/DestinationProfileName ()
/DestinationProfileSelector /DocumentCMYK
/Downsample16BitImages true
/FlattenerPreset <<
/PresetSelector /MediumResolution
>>
/FormElements false
/GenerateStructure false
/IncludeBookmarks false
/IncludeHyperlinks false
/IncludeInteractive false
/IncludeLayers false
/IncludeProfiles false
/MultimediaHandling /UseObjectSettings
/Namespace [
(Adobe)
(CreativeSuite)
(2.0)
]
/PDFXOutputIntentProfileSelector /DocumentCMYK
/PreserveEditing true
/UntaggedCMYKHandling /LeaveUntagged
/UntaggedRGBHandling /UseDocumentProfile
/UseDocumentBleed false
>>
]
>> setdistillerparams
<<
/HWResolution [2400 2400]
/PageSize [612.000 792.000]
>> setpagedevice
|