FOR OFFICIAL USE ONLY
Basic Internet Search Techniques
5 December 2006
FMI 2-22.9
I-3
FOR OFFICIAL USE ONLY
use to search for information. Once identified, the analyst or collector records these search terms and uses
them to locate information within the Internet.
Example
:
If a unit is planning a humanitarian assistance operation in the Sudan, the specific IR
may be “Where are refugee concentrations in the Sudan?” The task for the analyst could be,
“Locate the humanitarian relief organizations operating food distribution centers in the Sudan,”
“Locate population centers in the Sudan,” “Locate concentrations of militia forces in the
Sudan,” and “Identify areas of militia operations in the Sudan that occurred in the last 30 days.”
The location of NGO aid centers, food, water, and hostile paramilitary forces are possible
indicators of where refugees may or may not concentrate. Based on the SIRs and indicators, the
search objective is to locate refugee concentrations based on the position of food and militia
forces in the Sudan. The indicators that may be useful search terms include: Sudan, refugee,
humanitarian relief, food distribution, militia, and water sources.
I-8.
After determining the focus and keywords, the intelligence personnel use an Internet browser to
connect to a previously identified Internet site. If there are no previously identified sources, the analyst or
collector can connect to a communications or service site to collaborate with other analysts or use a search
engine to identify Internet sites, respectively. Since search engines do not index the entire Internet, the
communications capabilities of the Internet are important means of collaboration with authors, experts,
points of contact, and other people who know the information or have the information stored in off-line
databases or hardcopy.
CONDUCT
SEARCH
I-9.
Intelligence personnel should avoid the temptation of using one favorite search engine to the exclusion
of others. Each search engine has its strengths and weaknesses. Organizational standards, research
experience, and peer recommendations guide the selection of which search engine to use in any particular
situation. Generally, a thorough search often requires the use more than one search engine and even then,
the information may not be complete. As a rule, if a trained analyst or collector cannot find the
information using multiple search engines and common search techniques within 30 minutes, it is possible
that the information is not on the Internet, not indexed, or not in a retrievable format. At that point, the
analyst or collector should seek assistance from other personnel, digital but non-Internet resources such as
commercial and in-house databases, and non-digital resources available at government or university
libraries.
Search Engines
I-10.
Intelligence personnel use search engines and search terms to locate Internet sites and find
information within the Internet site. Search engines allow the user to search for text and images in millions
of web pages. The different commercial and government search engines vary in what they search, how
they search, and how they display results. Most search engines use programs called webcrawlers to build
indexed databases. A webcrawler searches Internet sites and files and saves the results in a database. The
search engine, therefore, is actually searching an indexed database not the content of the site or an online
database. The search results also vary between search engines because each engine uses different
webcrawlers and searches different sites. Most engines display search results in order of relevancy with a
brief description and a hyperlink to the referenced Internet file or site.
z
Webcrawler.
Search engines have an index database built by a webcrawler. The webcrawler or
spider is a different application than the search engine. The crawler is like some voracious
monster with an insatiable appetite, it roams the Internet 24 hours a day, 7 days a week,
searching for information. Once it finds a Website, it then indexes and saves it in a database
relevant to the search engine. Some search engines have their own spiders while others use
commercial contracted spider programs to develop their databases. In addition, each spider may