Add tests

1 files changed, 354 insertions, 0 deletions

diff --git a/tests/html/bbcnewsleaks.html.simple b/tests/html/bbcnewsleaks.html.simple
new file mode 100644
index 0000000..4b6043e
--- /dev/null
+++ b/tests/html/bbcnewsleaks.html.simple
@@ -0,0 +1,354 @@
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+<div style="width:38em; margin:auto; text-align:justify; font-family:sans;"><h1 style="text-align: center">BBC News - Huge Wikileaks release shows US 'ignored Iraq torture'</h1>    	
+        		  <span class="story-date">
+    <span class="date">23 October 2010</span>
+<span class="time-text">Last updated at </span><span class="time">09:42 GMT</span>  
+</span>
+
+	<div id="page-bookmark-links-head" class="share-help">
+  <h3>Share this page</h3>
+  <ul>  	
+    <li class="delicious">
+      Delicious
+    </li>
+    <li class="digg">
+      Digg
+    </li>
+    <li class="facebook">
+      Facebook
+    </li>
+    <li class="reddit">
+      reddit
+    </li>
+    <li class="stumbleupon">
+      StumbleUpon
+    </li>
+    <li class="twitter">
+      Twitter
+    </li>
+    <li class="email">
+      Email
+    </li>
+    <li class="print">
+      Print
+    </li>
+  </ul>
+<!--  Social media icons by Paul Annet | /icons  -->
+</div>
+<script type="text/javascript"> 
+<!--
+$render("page-bookmark-links","page-bookmark-links-head",{
+    position:"top",
+    site:'News', 
+    headline:'BBC News - Huge Wikileaks release shows US \'ignored Iraq torture\'', 
+    storyId:'11611319', 
+    sectionId:'99125', 
+    url:'/news/world-middle-east-11611319', 
+    edition:'International' 
+}); 
+-->
+</script>
+
+
+<h1 class="story-header">Huge Wikileaks release shows US 'ignored Iraq torture'</h1>
+    
+     
+         
+ 
+        		
+		        
+        <div class="caption body-narrow-width">
+  <img src="/media/images/49626000/jpg/_49626757_000777526-1.jpg" width="304" height="171" alt="Hooded Iraqi men are arrested by US troops in Baghdad (2004)">
+
+    <span>Some suspected insurgents held in Iraqi custody suffered abuse, according to the leaked records</span>
+  </div>
+                      <p class="introduction">Wikileaks has released almost 400,000 secret US military logs, which suggest US commanders ignored evidence of torture by the Iraqi authorities.  </p>
+        <p>The documents also suggest "hundreds" of civilians were killed at US military checkpoints after the invasion in 2003.</p>
+        <p>And the files show the US kept records of civilian deaths, despite previously denying it. The death toll was put at 109,000, of whom 66,081 were civilians.</p>
+        <p>The US criticised the largest leak of classified documents in its history.</p>
+  	<div class="story-feature related narrow">
+		Continue reading the main story		<h2>Related stories</h2>
+		<ul class="related-links-list">
+						<li>Tidal wave of secret files raises new questions on Iraq</li>
+											<li>What is Wikileaks?</li>
+											<li>Does the new release put lives at risk?</li>
+																	</ul>
+	</div>
+      <p id="story_continues_1">A US Department of Defense spokesman dismissed the documents published by the whistleblowing website as raw observations by tactical units, which were only snapshots of tragic, mundane events. </p>
+        <p>On allegations of abuse, he said it was policy always to report "potentially illegal abusive behaviour" so action could be taken.</p>
+        <p>At a news conference in London, Wikileaks founder Julian Assange said that those snapshots of everyday events offered a glimpse at the "human scale" of the conflict.</p>
+        <p>The deaths of one or two individuals made up the "overwhelming number" of people killed in Iraq, Mr Assange said. </p>
+        <p>The new documents and new deaths contained within them showed the range and frequency of the "small, relentless tragedies of this war" added John Sloboda of Iraq Body Count, which worked with Wikileaks.</p>
+        <p>Speaking to reporters in Washington on Friday, US Secretary of State Hillary Clinton said she condemned the disclosure and suggested the leaks put lives at risk.</p>
+        <p>However, Wikileaks said it was confident that the documents - published in a heavily censored form - contain "no information that could be harmful to any individual".</p>
+        <p>Wikileaks says it expects to launch legal proceedings as a result of information contained in the documents.</p>
+        <p><strong>'Nothing new'</strong></p>
+        <p>The 391,831 US army Sigacts (Significant Actions) reports published by Wikileaks on Friday describe the apparent torture of Iraqi detainees by the Iraqi authorities, sometimes using electrocution, electric drills and in some cases even executing detainees, says the BBC's Adam Brookes, who has examined some of the files.</p>
+        <p>The US military knew of the abuses, the documents suggest, but reports were sent up the chain of command marked "no further investigation", our correspondent adds.</p>
+  <div class="story-feature wide ">
+	Continue reading the main story		<h2>Analysis</h2>
+		<!-- pullout-items-->
+	<div class="byline">
+		<span class="byline-picture"><img src="/media/images/49626000/jpg/_49626981_adambrookes-1.jpg" alt="image of Adam Brookes"></span>
+		<span class="byline-name">Adam Brookes</span>
+	<span class="byline-title">BBC News</span>
+	<hr>
+</div>
+	<!-- pullout-body-->
+	      <p>The documents number in the hundreds of thousands. They take the form of reports written by soldiers after vicious firefights with insurgents, or after a roadside bomb has gone off, or the bodies of a family have been found murdered in an abandoned factory. Their language is military - hard and attenuated. </p>
+        <p>We found, with relative ease, reports of horrible abuse committed by Iraqi security forces on detainees - beatings, electrocution, the use of an electric drill on a man's legs. The Americans were aware the abuse had taken place. On some, not all, of these reports was marked "no further investigation", suggesting that American forces took no action on learning of the abuse. </p>
+        <p>The true lessons contained in these documents will take months or years to emerge. But an early question they pose is: why do Iraqi security forces appear to be continuing practices that might have died with the fall of Saddam Hussein's regime? And what has the United States done to end them?</p>
+  
+	<!-- pullout-links-->
+	</div>      <p id="story_continues_2">One document shows the US military was given a video apparently showing Iraqi Army (IA) officers executing a prisoner in the northern town of Talafar.</p>
+        <p>"The footage shows the IA soldiers moving the detainee into the street, pushing him to the ground, punching him and shooting him," states the log, which also names at least one of the perpetrators.</p>
+        <p>In another case, US soldiers suspected army officers of cutting off a detainee's fingers and burning him with acid. </p>
+        <p>Pentagon spokesman Geoff Morrell told the BBC that if abuse by the Iraqi security forces was witnessed, or reports of it were received, US military personnel were instructed to inform their commanders.</p>
+        <p>"And at the appropriate level that information would then be shared with the Iraqi authorities and the military for them to take action."</p>
+        <p>The documents also reveal many previously unreported instances in which US forces killed civilians at checkpoints and during operations.</p>
+        <p>In one incident in July 2007, as many as 26 Iraqis were killed by a helicopter, about half of them civilians, according to the log.</p>
+        <p>Another record shows an Apache helicopter gunship fired on two men believed to have fired mortars at a military base in Baghdad in February 2007, even though they were attempting to surrender. The crew asked a lawyer whether they could accept the surrender, but were told they could not, "and are still valid targets". So they shot them.</p>
+        <p>The helicopter - with the callsign "Crazyhorse 18" - was also involved in another incident that July in which two journalists were killed and two children wounded.</p>
+        <p>There are also new indications of Iran's involvement in Iraq, with reports of insurgents being trained and using weapons provided by the Islamic Revolution Guards Corps (IRGC).</p>
+        <p>Finally, the documents appear to show that the US military did keep records of civilian deaths, despite earlier denials that any official statistics on the death toll were available.</p>
+        <p>The logs showed there were more than 109,000 violent deaths between 2004 and the end of 2009.</p>
+  <!--  Embedding the video player -->
+<!--  This is the embedded player component -->
+
+
+	
+ 
+
+<div class="videoInStoryC">
+    <div id="emp-11611439-109697" class="emp">
+        		
+        <noscript></noscript>
+        <object width="0" height="0">
+            <param name="id" value="embeddedPlayer_11611439">
+                    <param name="width" value="320">
+            <param name="height" value="180">    
+                    <param name="size" value="Small">
+					<param name="holdingImage" value="/media/images/49627000/jpg/_49627041_jex_846239_de28-1.jpg">
+							<param name="externalIdentifier" value="p00brfy2">
+		            <param name="playlist" value="/news/world-us-canada-11611439A/playlist.sxml">
+            <param name="config_settings_autoPlay" value="false">
+            <param name="config_settings_showPopoutButton" value="false">
+            <param name="config_plugin_fmtjLiveStats_pageType" value="eav2">
+            <param name="config_plugin_fmtjLiveStats_edition" value="International">
+			
+		            <param name="fmtjDocURI" value="/news/world-middle-east-11611319">
+                
+            <param name="companionId" value="bbccom_companion_11611439">
+        
+                    <param name="config_settings_showShareButton" value="true">
+            <param name="config_settings_showUpdatedInFooter" value="true">
+        </object>
+        <!-- embedding script -->
+        
+        <script type="text/javascript">
+/*<![CDATA[*/
+	bbc.fmtj.av.emp.load( function() {
+		var userAgent = navigator.userAgent.toLowerCase();
+		if (bbc.fmtj.av.emp.loadProxyPlayer !== undefined && bbc.fmtj.page !== undefined && 
+			(bbc.fmtj.page.siteToServe === "news" || bbc.fmtj.page.siteToServe === "sport") &&
+			!(userAgent.search("safari") > -1 && userAgent.search("version/3.") > -1) &&
+			!(userAgent.search("windows") > -1 && userAgent.search("safari") > -1 && userAgent.search("version/4.") > -1) &&
+			userAgent.search("android") == -1)
+		{
+			bbc.fmtj.av.emp.loadProxyPlayer("emp-11611439-109697");
+		}else{
+			bbc.fmtj.av.emp.loadEmp("emp-11611439-109697");
+		}
+	});
+/*]]>*/
+</script>
+
+
+            </div>
+            <!-- companion banner --> 
+          
+		
+			<div class="bbccom_advert_placeholder">
+				<script type="text/javascript">$render("advert","advert-companion","11611439");</script>
+			</div>
+			<script type="text/javascript">$render("advert-post-script-load");</script>
+		
+         
+        <!-- END - companion banner --> 
+    	
+        		<!-- caption -->
+		<p class="caption">Hillary Clinton: "We should condemn in the most clear terms the disclosure"</p>
+		<!-- END - caption -->
+        </div>
+<!-- end of the embedded player component -->
+
+<!-- Player embedded -->      <p>They included 66,081 civilians, 23,984 people classed as "enemy", 15,196 members of the Iraqi security forces, and 3,771 coalition troops.</p>
+        <p>Iraq Body Count, which collates civilian deaths using cross-checked media reports and other figures such as morgue records, said that based on an analysis of a sample of 860 logs, it estimated that around 15,000 previously unknown civilian deaths would be identified.</p>
+        <p>The UK's Guardian newspaper also reported that the US military appeared not to have recorded any civilian deaths during its two major offensives on the city of Falluja in 2004.</p>
+        <p>Mr Morrell, of the Pentagon, told the BBC that the leak was a "travesty" which provided enemies of the West with an "extraordinary database to figure out how we operate".</p>
+        <p>He said the cache of documents contained "nothing new" with regards to fundamental policy issues.</p>
+  <!--  Embedding the audio player -->
+<!--  This is the embedded player component -->
+
+
+	
+ 
+
+<div class="audioInStoryC">
+    <div id="emp-11611520-109698" class="emp">
+        		
+        <noscript></noscript>
+        <object width="0" height="0">
+            <param name="id" value="embeddedPlayer_11611520">
+                    <param name="width" value="304">
+            <param name="height" value="71">    
+                    <param name="size" value="Small">
+				            <param name="playlist" value="/news/world-us-canada-11611520A/playlist.sxml">
+            <param name="config_settings_autoPlay" value="false">
+            <param name="config_settings_showPopoutButton" value="false">
+            <param name="config_plugin_fmtjLiveStats_pageType" value="eav2">
+            <param name="config_plugin_fmtjLiveStats_edition" value="International">
+			
+		            <param name="fmtjDocURI" value="/news/world-middle-east-11611319">
+                    <param name="config_settings_suppressItemKind" value="advert, ident">
+                    <param name="config_settings_showShareButton" value="true">
+            <param name="config_settings_showUpdatedInFooter" value="true">
+        </object>
+        <!-- embedding script -->
+        
+        <script type="text/javascript">
+/*<![CDATA[*/
+	bbc.fmtj.av.emp.load( function() {
+		var userAgent = navigator.userAgent.toLowerCase();
+		if (bbc.fmtj.av.emp.loadProxyPlayer !== undefined && bbc.fmtj.page !== undefined && 
+			(bbc.fmtj.page.siteToServe === "news" || bbc.fmtj.page.siteToServe === "sport") &&
+			!(userAgent.search("safari") > -1 && userAgent.search("version/3.") > -1) &&
+			!(userAgent.search("windows") > -1 && userAgent.search("safari") > -1 && userAgent.search("version/4.") > -1) &&
+			userAgent.search("android") == -1)
+		{
+			bbc.fmtj.av.emp.loadProxyPlayer("emp-11611520-109698");
+		}else{
+			bbc.fmtj.av.emp.loadEmp("emp-11611520-109698");
+		}
+	});
+/*]]>*/
+</script>
+
+
+            </div>
+    	
+            </div>
+<!-- end of the embedded player component -->
+
+<!-- Player embedded -->      <p>And he once again asked Wikileaks to remove the documents from the web and return them to the Department of Defense.</p>
+        <p>US Defence Secretary Robert Gates suggested the whistle-blowing website had blood on its hands in July after it published more than 70,000 secret papers about the war in Afghanistan. </p>
+        <p>The investigation into the Afghan leak has focused on Bradley Manning, a US army intelligence analyst who is in custody and has been charged with providing Wikileaks with a video of the July 2007 attack by a helicopter with the callsign Crazyhorse 18.</p>
+        <p>The release of the documents comes as the US military prepares to withdraw all 50,000 remaining troops from Iraq by the end of 2011. </p>
+        <p>Violence in the country has declined sharply over the past two years, but near-daily bombings and shootings continue.</p>
+             
+	
+	</div>
+