Inlining

There are several options that control which calls the analyzer will consider for inlining. The major one is -analyzer-config ipa:

• analyzer-config ipa=none - All inlining is disabled. This is the only mode available in LLVM 3.1 and earlier and in Xcode 4.3 and earlier.

• analyzer-config ipa=basic-inlining - Turns on inlining for C functions, C++

  static member functions, and blocks -- essentially, the calls that behave like simple C function calls. This is essentially the mode used in Xcode 4.4.

• analyzer-config ipa=inlining - Turns on inlining when we can confidently find

  the function/method body corresponding to the call. (C functions, static functions, devirtualized C++ methods, Objective-C class methods, Objective-C instance methods when ExprEngine is confident about the dynamic type of the instance).

• analyzer-config ipa=dynamic - Inline instance methods for which the type is

  determined at runtime and we are not 100% sure that our type info is correct. For virtual calls, inline the most plausible definition.

• analyzer-config ipa=dynamic-bifurcate - Same as -analyzer-config ipa=dynamic,

  but the path is split. We inline on one branch and do not inline on the other. This mode does not drop the coverage in cases when the parent class has code that is only exercised when some of its methods are overridden.

Currently, -analyzer-config ipa=dynamic-bifurcate is the default mode.

While -analyzer-config ipa determines in general how aggressively the analyzer will try to inline functions, several additional options control which types of functions can inlined, in an all-or-nothing way. These options use the analyzer's configuration table, so they are all specified as follows:

-analyzer-config OPTION=VALUE

c++-inlining

This option controls which C++ member functions may be inlined.

-analyzer-config c++-inlining=[none | methods | constructors | destructors]

Each of these modes implies that all the previous member function kinds will be inlined as well; it doesn't make sense to inline destructors without inlining constructors, for example.

The default c++-inlining mode is 'destructors', meaning that all member functions with visible definitions will be considered for inlining. In some cases the analyzer may still choose not to inline the function.

Note that under 'constructors', constructors for types with non-trivial destructors will not be inlined. Additionally, no C++ member functions will be inlined under -analyzer-config ipa=none or -analyzer-config ipa=basic-inlining, regardless of the setting of the c++-inlining mode.

c++-template-inlining

This option controls whether C++ templated functions may be inlined.

-analyzer-config c++-template-inlining=[true | false]

Currently, template functions are considered for inlining by default.

The motivation behind this option is that very generic code can be a source of false positives, either by considering paths that the caller considers impossible (by some unstated precondition), or by inlining some but not all of a deep implementation of a function.

c++-stdlib-inlining

This option controls whether functions from the C++ standard library, including methods of the container classes in the Standard Template Library, should be considered for inlining.

-analyzer-config c++-stdlib-inlining=[true | false]

Currently, C++ standard library functions are considered for inlining by default.

The standard library functions and the STL in particular are used ubiquitously enough that our tolerance for false positives is even lower here. A false positive due to poor modeling of the STL leads to a poor user experience, since most users would not be comfortable adding assertions to system headers in order to silence analyzer warnings.

c++-container-inlining

This option controls whether constructors and destructors of "container" types should be considered for inlining.

-analyzer-config c++-container-inlining=[true | false]

Currently, these constructors and destructors are NOT considered for inlining by default.

The current implementation of this setting checks whether a type has a member named 'iterator' or a member named 'begin'; these names are idiomatic in C++, with the latter specified in the C++11 standard. The analyzer currently does a fairly poor job of modeling certain data structure invariants of container-like objects. For example, these three expressions should be equivalent:

std::distance(c.begin(), c.end()) == 0
c.begin() == c.end()
c.empty()

Many of these issues are avoided if containers always have unknown, symbolic state, which is what happens when their constructors are treated as opaque. In the future, we may decide specific containers are "safe" to model through inlining, or choose to model them directly using checkers instead.

Basics of Implementation

The low-level mechanism of inlining a function is handled in ExprEngine::inlineCall and ExprEngine::processCallExit.

If the conditions are right for inlining, a CallEnter node is created and added to the analysis work list. The CallEnter node marks the change to a new LocationContext representing the called function, and its state includes the contents of the new stack frame. When the CallEnter node is actually processed, its single successor will be a edge to the first CFG block in the function.

Exiting an inlined function is a bit more work, fortunately broken up into reasonable steps:

1. The CoreEngine realizes we're at the end of an inlined call and generates a CallExitBegin node.
2. ExprEngine takes over (in processCallExit) and finds the return value of the function, if it has one. This is bound to the expression that triggered the call. (In the case of calls without origin expressions, such as destructors, this step is skipped.)
3. Dead symbols and bindings are cleaned out from the state, including any local bindings.
4. A CallExitEnd node is generated, which marks the transition back to the caller's LocationContext.
5. Custom post-call checks are processed and the final nodes are pushed back onto the work list, so that evaluation of the caller can continue.

Retry Without Inlining

In some cases, we would like to retry analysis without inlining a particular call.

Currently, we use this technique to recover coverage in case we stop analyzing a path due to exceeding the maximum block count inside an inlined function.

When this situation is detected, we walk up the path to find the first node before inlining was started and enqueue it on the WorkList with a special ReplayWithoutInlining bit added to it (ExprEngine::replayWithoutInlining). The path is then re-analyzed from that point without inlining that particular call.

Deciding When to Inline

In general, the analyzer attempts to inline as much as possible, since it provides a better summary of what actually happens in the program. There are some cases, however, where the analyzer chooses not to inline:

• If there is no definition available for the called function or method. In this case, there is no opportunity to inline.

• If the CFG cannot be constructed for a called function, or the liveness cannot be computed. These are prerequisites for analyzing a function body, with or without inlining.

• If the LocationContext chain for a given ExplodedNode reaches a maximum cutoff depth. This prevents unbounded analysis due to infinite recursion, but also serves as a useful cutoff for performance reasons.

• If the function is variadic. This is not a hard limitation, but an engineering limitation.

  Tracked by: <rdar://problem/12147064> Support inlining of variadic functions

• In C++, constructors are not inlined unless the destructor call will be processed by the ExprEngine. Thus, if the CFG was built without nodes for implicit destructors, or if the destructors for the given object are not represented in the CFG, the constructor will not be inlined. (As an exception, constructors for objects with trivial constructors can still be inlined.) See "C++ Caveats" below.

• In C++, ExprEngine does not inline custom implementations of operator 'new' or operator 'delete', nor does it inline the constructors and destructors associated with these. See "C++ Caveats" below.

• Calls resulting in "dynamic dispatch" are specially handled. See more below.

• The FunctionSummaries map stores additional information about declarations, some of which is collected at runtime based on previous analyses. We do not inline functions which were not profitable to inline in a different context (for example, if the maximum block count was exceeded; see "Retry Without Inlining").

Dynamic Calls and Devirtualization

"Dynamic" calls are those that are resolved at runtime, such as C++ virtual method calls and Objective-C message sends. Due to the path-sensitive nature of the analysis, the analyzer may be able to reason about the dynamic type of the object whose method is being called and thus "devirtualize" the call.

This path-sensitive devirtualization occurs when the analyzer can determine what method would actually be called at runtime. This is possible when the type information is constrained enough for a simulated C++/Objective-C object that the analyzer can make such a decision.

DynamicTypeInfo

As the analyzer analyzes a path, it may accrue information to refine the knowledge about the type of an object. This can then be used to make better decisions about the target method of a call.

Such type information is tracked as DynamicTypeInfo. This is path-sensitive data that is stored in ProgramState, which defines a mapping from MemRegions to an (optional) DynamicTypeInfo.

If no DynamicTypeInfo has been explicitly set for a MemRegion, it will be lazily inferred from the region's type or associated symbol. Information from symbolic regions is weaker than from true typed regions.

EXAMPLE: A C++ object declared "A obj" is known to have the class 'A', but a

reference "A &ref" may dynamically be a subclass of 'A'.

The DynamicTypePropagation checker gathers and propagates DynamicTypeInfo, updating it as information is observed along a path that can refine that type information for a region.

WARNING: Not all of the existing analyzer code has been retrofitted to use

DynamicTypeInfo, nor is it universally appropriate. In particular, DynamicTypeInfo always applies to a region with all casts stripped off, but sometimes the information provided by casts can be useful.

RuntimeDefinition

The basis of devirtualization is CallEvent's getRuntimeDefinition() method, which returns a RuntimeDefinition object. When asked to provide a definition, the CallEvents for dynamic calls will use the DynamicTypeInfo in their ProgramState to attempt to devirtualize the call. In the case of no dynamic dispatch, or perfectly constrained devirtualization, the resulting RuntimeDefinition contains a Decl corresponding to the definition of the called function, and RuntimeDefinition::mayHaveOtherDefinitions will return FALSE.

In the case of dynamic dispatch where our information is not perfect, CallEvent can make a guess, but RuntimeDefinition::mayHaveOtherDefinitions will return TRUE. The RuntimeDefinition object will then also include a MemRegion corresponding to the object being called (i.e., the "receiver" in Objective-C parlance), which ExprEngine uses to decide whether or not the call should be inlined.

Inlining Dynamic Calls

The -analyzer-config ipa option has five different modes: none, basic-inlining, inlining, dynamic, and dynamic-bifurcate. Under -analyzer-config ipa=dynamic, all dynamic calls are inlined, whether we are certain or not that this will actually be the definition used at runtime. Under -analyzer-config ipa=inlining, only "near-perfect" devirtualized calls are inlined*, and other dynamic calls are evaluated conservatively (as if no definition were available).

• Currently, no Objective-C messages are not inlined under -analyzer-config ipa=inlining, even if we are reasonably confident of the type of the receiver. We plan to enable this once we have tested our heuristics more thoroughly.

The last option, -analyzer-config ipa=dynamic-bifurcate, behaves similarly to "dynamic", but performs a conservative invalidation in the general virtual case in addition to inlining. The details of this are discussed below.

As stated above, -analyzer-config ipa=basic-inlining does not inline any C++ member functions or Objective-C method calls, even if they are non-virtual or can be safely devirtualized.

Bifurcation

ExprEngine::BifurcateCall implements the -analyzer-config ipa=dynamic-bifurcate mode.

When a call is made on an object with imprecise dynamic type information (RuntimeDefinition::mayHaveOtherDefinitions() evaluates to TRUE), ExprEngine bifurcates the path and marks the object's region (retrieved from the RuntimeDefinition object) with a path-sensitive "mode" in the ProgramState.

Currently, there are 2 modes:

• DynamicDispatchModeInlined - Models the case where the dynamic type information

  of the receiver (MemoryRegion) is assumed to be perfectly constrained so that a given definition of a method is expected to be the code actually called. When this mode is set, ExprEngine uses the Decl from RuntimeDefinition to inline any dynamically dispatched call sent to this receiver because the function definition is considered to be fully resolved.

• DynamicDispatchModeConservative - Models the case where the dynamic type

  information is assumed to be incorrect, for example, implies that the method definition is overridden in a subclass. In such cases, ExprEngine does not inline the methods sent to the receiver (MemoryRegion), even if a candidate definition is available. This mode is conservative about simulating the effects of a call.

Going forward along the symbolic execution path, ExprEngine consults the mode of the receiver's MemRegion to make decisions on whether the calls should be inlined or not, which ensures that there is at most one split per region.

At a high level, "bifurcation mode" allows for increased semantic coverage in cases where the parent method contains code which is only executed when the class is subclassed. The disadvantages of this mode are a (considerable?) performance hit and the possibility of false positives on the path where the conservative mode is used.

Objective-C Message Heuristics

ExprEngine relies on a set of heuristics to partition the set of Objective-C method calls into those that require bifurcation and those that do not. Below are the cases when the DynamicTypeInfo of the object is considered precise (cannot be a subclass):

• If the object was created with +alloc or +new and initialized with an -init method.
• If the calls are property accesses using dot syntax. This is based on the assumption that children rarely override properties, or do so in an essentially compatible way.
• If the class interface is declared inside the main source file. In this case it is unlikely that it will be subclassed.
• If the method is not declared outside of main source file, either by the receiver's class or by any superclasses.

C++ Caveats

C++11 [class.cdtor]p4 describes how the vtable of an object is modified as it is being constructed or destructed; that is, the type of the object depends on which base constructors have been completed. This is tracked using DynamicTypeInfo in the DynamicTypePropagation checker.

There are several limitations in the current implementation:

• Temporaries are poorly modeled right now because we're not confident in the placement of their destructors in the CFG. We currently won't inline their constructors unless the destructor is trivial, and don't process their destructors at all, not even to invalidate the region.
• 'new' is poorly modeled due to some nasty CFG/design issues. This is tracked in PR12014. 'delete' is not modeled at all.
• Arrays of objects are modeled very poorly right now. ExprEngine currently only simulates the first constructor and first destructor. Because of this, ExprEngine does not inline any constructors or destructors for arrays.

CallEvent

A CallEvent represents a specific call to a function, method, or other body of code. It is path-sensitive, containing both the current state (ProgramStateRef) and stack space (LocationContext), and provides uniform access to the argument values and return type of a call, no matter how the call is written in the source or what sort of code body is being invoked.

NOTE: For those familiar with Cocoa, CallEvent is roughly equivalent to

NSInvocation.

CallEvent should be used whenever there is logic dealing with function calls that does not care how the call occurred.

Examples include checking that arguments satisfy preconditions (such as __attribute__((nonnull))), and attempting to inline a call.

CallEvents are reference-counted objects managed by a CallEventManager. While there is no inherent issue with persisting them (say, in a ProgramState's GDM), they are intended for short-lived use, and can be recreated from CFGElements or non-top-level StackFrameContexts fairly easily.