text:
Farm Lease Program Set
Much like residential and commercial leasing, the leasing of farms continues to evolve. Next Thursday, November 6th,. Missouri Extension will conduct a farm lease program at the Adair County Extension Center. There is a registration fee, which includes one set of materials and a light meal. Pre-registration is required by November 3rd.
Darla Campbell, an agricultural business specialist with University of Missouri Extension, says the program includes discussions of current cash rents in Missouri and trends, which items to discuss and agree on in a lease, how to end a farm lease, cautions concerning recreational leases and keeping livestock and crop share arrangements fair for both sides.
Oct. 30, 2014 at 7:47 am
Highway patrol planning crackdown
The Missouri State Highway Patrol is cracking down on drunk drivers. The patrol has announced that sometime next month, Troop B officers will conduct three DWI enforcement saturations throughout the Troop B area. During these operations, troopers will focus on detecting intoxicated drivers, hazardous moving violations, speed, and other traffic violations that cause traffic crashes.
Oct. 29, 2014 at 11:19 am
Hazardous and E-Waste Dropoff Set for Saturday
A free hazardous waste drop-off event is planned soon in Macon. The event is Saturday morning from 9am to 1pm at Macon County Park. Not only will officials be accepting household hazardous wastes such as paints, used oil, anti-freeze and batteries, but they'll also accept e-waste — almost anything with a cord except appliances. Some e-waste examples include computers, monitors, TV's stereos and printers. The drop-off event Saturday will be held rain or shine. If you need to know more, call Cindy Hultz at 573-565-2203.
Blood drive set in honor of crash victim
If you haven't donated blood in a while, mark November 8th on your calendar. That's the date of the annual Red Cross blood drive, held in memory of a local woman who died after a car accident in 2010. Bridget Kurz was 24 when she died following a car acident and subsequent surgery. She received blood transfusions in an attempt to save her life. Her sister, Mindy Kurz, says holding the blood drive makes the family feel like they're giving back to those who helped Bridget. The blood drive is set for Saturday November 8th, from 10 a.m. until 2 p.m., at Mary Immaculate Catholic Church, which is at 716 East Washington in Kirksville. All blood types are needed.
Boil water advisory in effect for some
An area of Kirksville is under a 48-hour boil water advisory. The advisory started at 9:30 a.m. today and is in effect until 9:30 a.m. Friday. It applies to people who live on Elson between Porter and Elizabeth.
Oct. 22, 2014 at 3:49 pm
Kirksvile Council Discusses Pay
There are a number of other cities Kirksville's size in the region where city council members receive more of a stipend for their work than do the council members here. That has part of the council pushing to implement pay raises for future council members in Kirksville. The idea was raised recently at a study session, and came up again during this week's regular meeting. Right now, council members receive $50 for each regular or special meeting they attend where city business is discussed and a vote is taken. The proposal is to up that to $200 a month for council members and $300 a month for the mayor; Richard Detwiler flatly opposed both ideas, as did Jerry Mills. The proposal came from Mayor Glen Moritz with support from Bob Russell. While Richard Steele offered the numbers, he said initially he was on the fence about it, then said he rally was leaning toward it. That was enough to get the matter on a future agenda for a formal vote.
Kirksville Water Rate Hike Approved
We'd told you earlier this was coming, and Kirksville city leaders have followed through with their plan to hike local utility rates. On a split vote, the council last night approved an increase in water bills that ranges from 10-percent to almost 11-percent based on your water usage, with the largest percentage increase for the lower usage levels. Water bills will continue to rise, council members remind, because they passed a plan last year to provide a stable funding source for the system. That plan includes nearly automatic price hikes annually. For the average household it means an increase of about $3.00 a month this year.
Kirksville gets set for veteran event
An event we're looking ahead to next month: The Adair County Veterans organizations and Disabled American Veterans' chapter 48 will host the community Veterans' Day ceremony on Tuesday November 11th at 11 a.m. at VFW post 2508, at 21464 Parallel Road in Kirksville. The featured speaker will be Glenn Ballew, director of the Kirksville Regional Airport, and a U.S. army veteran.
Truman State Student killed
A Truman State University student was killed Saturday night in Kirksville. The student was a 19 year old who was hit by a vehicle near Jefferson and Fible. The victim was found several blocks away, and was taken to the hospital, but nothing could be done. The driver who hit the student was identified as a 41 year old man from Tennessee, but no other information given. The investigation into how it happened continues.
Truman Student killed


text:
Boys Cross Country: Davidson places second in Division I state meet
Steve Blackledge The Columbus Dispatch
KIRKERSVILLE — The Hilliard Davidson High School boys cross country team is going to need to make more room in its trophy case.
Davidson continued its string of success Nov. 10 by finishing runner-up to Hudson for the second straight year in the Division I championship race at National Trail Raceway. The Explorers outscored the Wildcats 107-153. Mason (158) was third.
Gahanna (244) and Pickerington North (256) took seventh and eighth place, respectively.
"We're real pleased to come out of here with a trophy again," Davidson coach Pat Schlecht said. "Hudson's a great nationally ranked team and we needed to run a near-perfect race to beat them. Looking at the stats, our fifth scorer had to be a little closer for us to have a chance. There was a rather large displacement there."
The Wildcats, who will run at the Nike NXN regional race in Terre Haute, Indiana, on Nov. 11, were led by Conner Johanssen (eighth, 16 minutes, 16.2 seconds) and Max LeClair (29th, 16:44.4). Their fifth runner, however, came in 112th.
"We knew how good Hudson was and we kept our goals realistic and that was to get on the podium," said Johanssen, who surged from 15th in the final 1,000 meters.
Since 2000, Davidson has won the state once (2002), been runner-up four times and cracked the top five five additional times.
The area's top finisher in the race was regional champion Matt Duvall of Pickerington North, who took seventh (16:13) just ahead of Johanssen.
"The pace went out a little too fast and I tried to draft off some other runners for a while until I was ready to make my move," Duvall said. "I didn't do exactly what I wanted to do strategy-wise, but I was kind of hoping to get third or fourth coming in. All things considered, I'm pretty happy."
Elliott Cook of Dublin Jerome took 11th (16:20.5).
In Division II, Peninsula Woodridge captured its eighth title with 109 points. Regional champion Heath was fifth (200).
"Honestly, we did about as well as we could," Heath coach Scott Brown said. "We just wanted to make a run at it. We didn't get out quite as fast as we would have liked and that came back to bite us. But it's a young group and we hope to be back again next year."
Xavier Foehl of Heath was the area's top finisher, placing 15th in 16:47.2. Luke Malone of Jonathan Alder was 19th (16:51.4).
Fort Loramie won the Division III title with 127 points. Mount Gilead was fifth (165) and Fredericktown eighth (189).
Taylor Vallangeon of Worthington Christian topped the area contingent, placing ninth in 16:52.8.
"I came in wanting to go under 16 minutes but the conditions didn't cooperate," Vallangeon said, referring to sub-freezing temperatures and a muddy course that resulted in considerably slower times for all runners. "I was in the top six or seven for a while, but it feels good to make the top 10."
The individual champions were Conant Smith of Middletown (15:43.4) in Division I, Kyle Johnston of Lexington (15:52.9) in Division II and Noah Fisher of Defiance Ayersville (16:14.4) in Division III.
sblackledge@dispatch.com
@BlackiePreps

redpajama_set_name: RedPajamaCommonCrawl


Please do not remove any labels on this graphics card. If you Buy It Now, you'll only be purchasing this item. Page 20 Set Up Multiple Displays NVIDIA nView technology enables you to view your desktop in one of several multi-display modes to make the best use of the displays monitors that are connected to your computer.
Don't show me this message again. Make Gigabyte gv-n2200c-1gi – Loading Then the driver installation gigabgte completed. Resume making your offergigabyte gv-n2200c-1gi the page does not update immediately.
gigabyte gv-n2200c-1gi Add to watch list. This item will be shipped through the Global Shipping Program and includes international tracking.
First make sure your system has installed DirectX 9 or later version. Click the Install button. Be gigabyte gv-n2200c-1gi first to write a review.
Credit Cards processed by PayPal Special financing available. Solvusoft's close relationship with Microsoft as a Gold Certified Partner enables us to provide best-in-class software solutions that gigabyte gv-n2200c-1gi optimized for performance on Windows operating systems.
Ensure that the display cable is securely fastened to the card's display connector. Set Up Multiple Displays NVIDIA nView technology enables you to view gigabyte gv-n2200c-1gi desktop in one of several multi-display modes to make the best use of the displays monitors that gigabyte gv-n2200c-1gi connected to your computer.
Minimum monthly payments are required. The height of gigabyte gv-n2200c-1gi display is half the height of the total virtual desktop height. The item you've selected was not added to your cart. Don't have an account? If you'd like to get the additional items you've selected to gigabyte gv-n2200c-1gi for this offer, close this window and add these items to your cart.
Solvusoft is recognized by Gigabyte gv-n2200c-1gi as a leading Independent Software Vendor, achieving the gigabyte gv-n2200c-1gi level of completence and excellence in software development. Delivery times may vary, especially gigabyte gv-n2200c-1gi peak periods.
Page 11 Step 3: Driver and Utility Installation Finally, we suggest that you practice other environmentally friendly actions by understanding and using the energy-saving features of this product where applicablerecycling the inner and outer packaging including shipping ggigabyte this product was delivered in, gv-m2200c-1gi by disposing of or recycling used batteries properly.
This manual also for: Mouse over to Zoom – Click to enlarge. Learn More – opens in a new window or gigabyte gv-n2200c-1gi. As gv-n2200c1gi Gold Certified Independent Software Vendor ISVSolvusoft is able to provide the highest level of customer satisfaction through delivering top-level software and service solutions, which have gigabyte gv-n2200c-1gi subject to a rigourous and continually-audited approval process by Microsoft.
Doing so may void the warranty of this card. Gigabyte gv-n2200c-1gi may be subject to additional charges for customs clearance. Gigabyte gv-n2200c-1gi is a lifelong computer geek and loves everything related gigabyte gv-n2200c-1gi computers, software, and new technology. Comments to this Manuals Your Name. Page 19 Adjust Desktop Color Settings Use this page to set the contrast, sharpness, and color depth Digital Vibrance of the im- ages on your desktop.


text:
Learning Festival Success at Pool Academy
Minecraft, crime solving and 3D painting helped to make a successful learning festival at Pool Academy.
The school was one of the first in the country to host the Accessibility Learning Festival recently.
A selection of Year 5 to Year 8 children from across the county were invited along to take part in a number of technology-led workshops during the one-day event.
A 'crime scene' with police tape had been set up in the corner of the school gym and youngsters had to use their problem solving skills to figure out clues.
There was a Minecraft Education Edition workshop. Minecraft is a computer game using blocks to build adventures and youngsters had to make structures and then write instructions for others to follow.
Other sessions saw youngsters using QR codes, discovering computer coding with a pocket sized computer and a 3D painting workshop.
Five secondary schools signed up for the morning sessions and six primary schools took part in the afternoon.
Pool Academy student Finley, Year 7, said: "I loved the festival. It was really good fun. I enjoyed the Minecraft session."
Michael, Year 8, said: "I enjoyed it. It was good to work with others too. The crime scene was good although we couldn't find the fourth clue."
Mr Buckingham, from Pool Academy, said: "It is always a pleasure to welcome staff and students from other schools into the Academy. We have developed a close relationship with Tablet Academy over the last 18 months and this has resulted in us being able to host some fantastic events.
"These experiences have benefited a huge number of students, both primary and secondary and across all ability ranges."
David Fuller, Tablet Academy Principal Education Consultant, led the festival workshops.
He said: "I really like doing the festivals at Pool Academy. Mr Buckingham is an outstanding organiser.
"The children seem to be really enjoying the festival. The challenges they have been given are challenging but in a nice way."
Mr Fuller said the workshop sessions were created to include a number of different learning skills including literature, arts, biology and problem solving.
He thanked the school for all its efforts in helping with the preparation of the event
The festival has been provided thanks to a partnership between Tablet Academy and BT Business Direct.
The free event was split into two workshop sessions, morning and afternoon, each lasting about two and a half hours.
Newer PostPool Academy poets' work selected to represent Cornwall at international festival
Older PostPool Academy teacher surprised with a Certificate of Excellence.


text:
package joshie.progression.api.special;

import joshie.progression.api.criteria.IField;

import java.util.List;

/** Implement this on rewards, conditions, triggers, filters,
 *  where you wish to add special fields to be loaded, as well
 *  as or instead of the default loading */
public interface ISpecialFieldProvider {
    /** Add extra fields, If you wish to only use your new fields,
     *  Just clear the list. **/
    public void addSpecialFields(List<IField> fields, DisplayMode mode);
}

redpajama_set_name: RedPajamaGithub


Black Friday is the day after Thanksgiving where many shoppers look for great deals on electronics. This Black Friday ads are usually kept secret until you receive the circulars in your Thanksgiving Day newspaper.
As we get closer to Black Friday 2010, major retailers like Walmart and Sears are planning early Black Friday sales to get a jump on early Christmas shopping as family budgets tighten.
GameStop will be offering great deals on video game console bundles along with PS3, Xbox 360, Nintendo Wii, and DS games. Walmart has announced big savings on toys to kick off the pre-holiday season. Also, watch for great bargains this year on flat screen TVs, laptops, and other electronics as already low prices are slashed to the bone for clearance.
Keep an eye on this post as we will be updating it with all the latest information as it becomes available.


Impellers are keyed directly to the motor rotor. Bearing sensors, located at each magnetic bearing, feedback rotor orbit and thrust/axialinformation in real time tobearing control. Chief among them are increased energy efficiency, the elimination of..
Retrieved from m guide. Retrieved from Hughes,. How does NVC differ from Language? Besides, the elements in the communication process determine the quality of communication. As a resulut some of us use to raise the..
Your job is to use logic to fill in the missing digits and complete the grid. 3 Pages (1,188 Words) - Last Modified: 11th May, 2017 Plath's Suicide: Considering Lazarus Born on October 27, 1932..
and local energy governance. Examination of proficiency in fields most relevant to the proposed research, from within the following writing a proposal to renovate a cementry three subjects. The program is directed by Professor John Mutter. Chandra Kiran Krishnamurthy : (2011) Chandra has varied research interests, including measuring climate change-impact, valuing complex ecosystems, and modeling the dynamics of economic and environmental issues.
Financial, statements, ifrs, StatTools, Equity Research, Fixed Income Analysis, Equity Derivatives). I should make that clear thanks all the blog posts are written by me, Will Hall, producer and host of madness radio. Disease, ed Friedlander,.D., Pathologist No texting or chat messages, please. How to make your scholarship, application essay stand out from the rest. I am a sort of straight forward person, who would not get afraid of what other would say if I daringly say my opinion, which might not get approved by others in my family.
In Chemistry from the University of Tokyo, where he studied long-range chemical transport of air pollutants (ozone in particular) over East Asia. Gordon McCord : (2011) Gordon has varied interests, including economic growth and poverty reduction, the role of geography in economic dynamics, and the interaction of epidemiology and poverty (particularly in the case of malaria). Aaron is now Assistant Professor in the Department of Health System Design Global Health at the Icahn School of Medicine at Mount Sinai and an Economist at Arnhold Institute for Global Health Kayleigh B Campbell : (2017) Kayleigh is interested in how urban transportation shapes. Members of the PhD examining committee must be given a minimum of three weeks each to read the thesis, so the defense may comfortably be scheduled after distribution. For four summers she participated in the Significant Opportunities in Atmospheric Research and Science (soars) internship, where she worked at the National Center for Atmospheric Research (ncar).
Margaret is currently a foreign services officer at the US Department of State. She holds.A. Waite III Professor of Social Enterprise Research Interests: Risk, Environmental Economics, Decision Making Upmanu Lall, Alan and lucia di lammermoor dessay met Carol Silberstein Professor of Earth and Environmental Engineering (dees) and of Civil Engineering and Engineering Mechanics; Department Chair - dees Research Interests: Water, Climate Change, Environment, Natural Resource Management. Drawing on a year of ethnographic fieldwork in Egypt, her research traced the linkages between farmers' everyday practices of water use and regional, national, and international policy-making on water resources management. You should set aside.5 hours for the exam. Phil., students must also submit a dissertation prospectus.
Essay help chat roomBut writing a thesis paper may turn into a nightmare if you how to write synopsis for phd thesis. A Unique, innovation, plan is, critical to your Companys. Great Grad School Application Essay Examples By CollegeXpress; Daniel Masciello; Bridget Sullivan; Haviland Johannesson-Forgit.


Magia, line of living-room carpets.
Reversible carpet with a 35 mm border.
Colours: white and beige, see the images.
The image nr.3 represents the thickness of the carpet (Magia 3005 carpet).
Professional cleansing is recommended; wash it horizontally at 30° with a mild soap.


Please click on the attachments to open the health history form and notice of privacy practices. These forms will needed to be completed before your first appointment. You may bring them with you on the day of your appointment. Please contact us if you have any questions. We look forward to meeting you!


text:
package net.canadensys.dataportal.vascan;

/**
 * Service used to access dynamic images.
 * @author canadensys
 *
 */
public interface ImageService {

	/**
	 *
	 * @param taxonId
	 * @param imageExtension
	 * @return the image absolute path or null if the image could not be generated
	 */
	public String getImage(Integer taxonId, String imageExtension);
}


text:
Guma o Goma (cinese:固玛镇; pinyin: Gùmǎ Zhèn, uiguro: گۇما بازىرى), nota in precedenza come Pishan (caratteri cinesi: 皮山镇; pinyin: Píshān) è un'antica città-oasi situata sulla principale rotta di carovane che univa Khotan a Karghalik. Si trova nel deserto di Taklamakan, circa 280 km a sud-est di Kashgar, nell'attuale Xinjiang (Cina).

Il libro degli Han (che descrive gli eventi occorsi fino all'anno 23) dice che conteneva 500 case e 3500 persone di cui 500 in grado di maneggiare armi. Era un importante centro per le carovane che viaggiavano a sud verso l'India, sulla rotta per Karakorum, o attraverso il Pamir verso Jalalabad o Badakhshan.

Oggi Pishan è una piccola e piuttosto povera città di 2000 abitanti. Il principale raccolto è il cotone. Molti suoi abitanti sono Uiguri, e si contano anche alcuni Pamiri.

Bibliografia

 John E. Hill, Annotated Translation of the Chapter on the Western Regions according to the Hou Hanshu, 2003, seconda edizione
 John E. Hill, The Peoples of the West from the Weilüe 魏略 by Yu Huan 魚豢: A Third Century Chinese Account Composed between 239 and 265 CE, 2004
 A. F. P. Hulsewé e M. A. N. Loewe, China in Central Asia: The Early Stage 125 BC – AD 23: an annotated translation of chapters 61 and 96 of the History of the Former Han Dynasty, 1979, E. J. Brill, Leiden
 George N. Roerich, Trails to Inmost Asia: Five Years of Exploration with the Roerich Central Asian Expedition, 1931, Roerich, Book Faith India, Delhi

Centri abitati dello Xinjiang
Oasi della Cina
Città lungo la via della seta
deserto del Taklamakan

redpajama_set_name: RedPajamaWikipedia


text:
Enceladus (Raw Image 4)
This image has not been validated or calibrated. A validated/calibrated image will be archived with the NASA Planetary Data System in 2012.
For more information on raw images check out our Frequently Asked Questions section.
Credit: NASA/JPL-Caltech/Space Science Institute
Two large craters named after characters in Homer's Odyssey take the stage in this scene on Saturn's moon Tethys. The crater on the right is the Odysseus crater (450 kilometers, or 280 miles acros...
Odysseus and Penelope
This image from NASA's Dawn spacecraft shows four large impact craters close to one another on Vesta's surface. Interestingly, each of these four has a distinct preservation state.
Impact Craters with Different Preservation States
This image from NASA's Dawn spacecraft of asteroid Vesta shows a long chain of craters in the right part of the image, located in Vesta's Caparronia quadrangle, in Vesta's northern hemisphere.
Chain of Craters
On the final flyby of Cassini's original four-year tour, its radar mapper captured these unusual channels on Titan at the edge of Xanadu, the widest seen in this area. (For a radar image of Xanadu ...
Xanadu's Channels
Enceladus in the Distance November 3, 2004 Full-Res: PIA06512 Cassini spied the moon Enceladus in the distance beyond Saturn's so...
Enceladus in the Distance
Cassini Enters Saturn's Orbit July 1, 2004 After becoming the first spacecraft to enter Saturn'...
Cassini Enters Saturn's Orbit
This picture captured by NASA's Dawn spacecraft shows a crater that lies just north of Occator Crater, home of the brightest spots on Ceres. The northern rim of Occator, not visible here, is overpr...
This enhanced color mosaic combines some of the sharpest views of Pluto that NASA's New Horizons spacecraft obtained during its July 14 flyby.
Pluto's Close-up, Now in Color
New Radiation Belt August 5, 2004 The magnetospheric imaging instrument onboard Cassini recentl...
New Radiation Belt
The ringed planet wears a broad grin in this image from Cassini, as the icy rings cast long, sweeping shadows across the northern hemisphere. Fantastic details are visible in the bright and dark of...
Saturn's Smile
Saturn's little moon Atlas orbits Saturn between the outer edge of the A ring and the fascinating, twisted F ring. This image just barely resolves the disk of Atlas, and also shows some of the knot...
A Glimpse of Atlas
In KSC's Payload Hazardous Servicing Facility, Charley Kohlhase (left), then Cassini's science and mission design manager, and Richard Spehalski, then program manager of the Cassini mission, displa...
Cassini radar sees sand dunes on Saturn's giant moon Titan (upper photo) that are sculpted like Namibian sand dunes on Earth (lower photo). The bright features in the upper radar photo are not clou...
Titan's Sand Dunes
NASA's Dawn spacecraft shows Azacca Crater has a prominent set of north-south trending fractures. Its floor is relatively smooth and its rim has terraces descending toward its floor. Azacca was nam...
Dawn LAMO Image 80
Presented here is a complete set of cartographic map sheets from a high-resolution atlas of Saturn's moon Rhea, made from data obtained by the imaging cameras on NASA's Cassini spacecraft. The map...
The Rhea Atlas
2001 Mars Odyssey's Thermal Emission Imaging System (THEMIS) took this portrait of the Earth and its companion Moon, using the infrared camera, one of two cameras in the instrument. It was taken at...
The Earth and Moon As Seen by 2001 Mars Odyssey
Cassini imaging scientists use special images like this one, which shows the far side of Saturn's rings disappearing behind the planet's outer atmosphere, to probe the vertical structure of Saturn'...
Rings' Disappearing Act
This image from NASA's Dawn spacecraft shows Dantu Crater. The numerous bright spots found across the crater suggest bright material may be just below the surface, exposed through small impacts and...
Dantu Crater
Resembling ornaments hanging from Saturn's rings, two moons accent this portrait of the planet. The moon Enceladus (504 kilometers, or 313 miles across) is on the right. Dione (1,123 kilometers, o...
Ornamented Rings
This artistic interpretation of the Sikun Labyrinthus area on Saturn's moon Titan is based on radar and imaging data from NASA's Cassini spacecraft and the descent imaging and spectral radiometer o...
Sikun Labyrinthus, an Artistic View
Looming like a giant flying saucer in our outer solar system, Saturn puts on a show as the planet and its magnificent ring system nod majestically over the course of its 29-year journey around the ...
A Change of Seasons on Saturn
This two-in-one view of Dione from NASA's Cassini spacecraft includes the mission's highest-resolution view of the Saturnian moon's icy surface.
Cassini's Closest Views of Dione I (B)
Three different false-color views of Saturn's moon Iapetus show the boundary of the global "color dichotomy" on the hemisphere of this moon facing away from Saturn. The "color dichotomy," which has...
Color Dichotomy on Iapetus
Feathery cloud bands fill Saturn's graceful crescent. Features in the atmosphere are visible all the way to the terminator, the boundary between night and day, where the Sun's rays are coming in al...
Clear Sky on High


Current Operations and Background — AuraSource, Inc. ("AuraSource" or "Company") focuses on the development and production of environmentally friendly and cost effective industrial energy and fuel used for industrial applications. AuraCoal, AuraSource's core technology, includes ultrafine grinding and impurities removal processes. Initial industrial applications of AuraSource technology are ultra-fine coal water mixture for heavy oil substitution, and low grade iron ore fine and slimes beneficiation. AuraSource formed AuraSource Qinzhou Co. Ltd. ("Qinzhou"), a wholly owned subsidiary in China, to acquire these types of Hydrocarbon Clean Fuel ("HCF") technologies, performing research and development ("R&D") related to the reduction of harmful emissions and energy costs for HCF technology and products based on this technology, licensing HCF technology to third parties and selling services and products derived from this technology. Currently we have developed two patent pending technologies: 1) ultrafine grinding and 2) ultrafine separation.
There can be no assurance we will be able to carry out our development plans for our HCF technology, including AuraCoal and AuraFuel. Our ability to pursue this strategy is subject to the availability of additional capital and further development of our HCF technology. We also need to finance the cost of effectively protecting our intellectual property rights in the United States ("US") and abroad where we intend to market our technology and products.
Going Concern — The accompanying consolidated financial statements were prepared assuming the Company will continue as a going concern. The Company has suffered recurring losses from operations since its inception and has an accumulated deficit of $9,072,463 at September 30, 2013. The consolidated financial statements do not include any adjustments relating to the recoverability and classification of recorded asset amounts or amounts and classifications of liabilities that might be necessary should the Company be unable to continue its existence. The recovery of the Company's assets is dependent upon continued operations of the Company. In addition, the Company's recovery is dependent upon future events, the outcome of which is undetermined. The Company intends to continue to attempt to raise additional capital, but there can be no certainty such efforts will be successful.
Basis of Presentation and Principles of Consolidation — The accompanying consolidated financial statements were prepared in conformity with accounting principles generally accepted in the United States of America ("US GAAP") and include the accounts of AuraSource and its subsidiary, Qinzhou. All significant intercompany transactions and balances were eliminated in consolidation.
The unaudited consolidated financial statements were prepared by us pursuant to the rules and regulations of the Securities and Exchange Commission ("SEC"). The information furnished herein reflects all adjustments (consisting of normal recurring accruals and adjustments) which are, in the opinion of management, necessary to fairly present the operating results for the respective periods. Certain information and footnote disclosures normally present in annual consolidated financial statements prepared in accordance with US GAAP was omitted pursuant to such rules and regulations. These consolidated financial statements should be read in conjunction with the audited consolidated financial statements and footnotes for the year ended March 31, 2013 included in our Annual Report on Form 10-K. The results of the three and six months ended September 30, 2013 are not necessarily indicative of the results to be expected for the full year ending March 31, 2014.
Use of Estimates — The preparation of consolidated financial statements in conformity with US GAAP requires management to make estimates and assumptions that affect the reported amounts of assets and liabilities and disclosure of contingent assets and liabilities at the date of the consolidated financial statements and the reported amounts of revenues and expenses during the reporting period. Actual results could differ from those estimates.
Cash and Equivalents — We consider investments with original maturities of 90 days or less to be cash equivalents.
Income Taxes — The Company accounts for income taxes in accordance with Financial Accounting Standards Board ("FASB") Accounting Standards Codification ("ASC") Topic 740, "Income Taxes." Deferred tax assets and liabilities are recognized to reflect the estimated future tax effects, calculated at currently effective tax rates, of future deductible or taxable amounts attributable to events that have been recognized on a cumulative basis in the financial statements. A valuation allowance for a deferred tax asset is recorded when it is more likely than not that some portion of the deferred tax asset will not be realized.
Stock-Based Compensation — The Company recognizes the cost of employee services received for an award of equity instruments in the consolidated financial statements over the period the employee is required to perform the services.
Foreign Currency Transactions — The Company recognizes foreign currency gains and losses in other income (expense) on the accompanying statement of operations. Foreign currency gains and losses arise as the Company conducts business with other entity's whose functional currency is not in US dollars. Generally, these gains and losses are recorded at an exchange rate difference between the foreign currency and the functional currency that arises between the transaction date and the payment date.
Net Loss Per Share — The Company computes basic and diluted net loss per share by dividing the net loss available to common stockholders for the period by the weighted average number of shares of common stock outstanding during the period. Common equivalent shares arising from stock options and warrants were excluded from the computation of basic and diluted earnings per share, for the three and six months ended September 30, 2013 and 2012 because their effect is anti-dilutive.
Concentration of Credit Risk — Financial instruments that potentially subject the Company to a concentration of credit risk consist of cash. The Company maintains its cash with high credit quality financial institutions; at times, such balances with any one financial institution may exceed Federal Deposit Insurance Corporation ("FDIC") insured limits.
Financial Instruments and Fair Value of Financial Instruments — Our financial instruments consist of cash, accounts payable and notes payable. The carrying values of cash, accounts payable and notes payable are representative of the fair values due to their short-term maturities. We measure the fair value ("FV") of financial assets and liabilities on a recurring basis. FV is defined as the price that would be received to sell an asset or paid to transfer a liability in an orderly transaction between market participants at the measurement date. FV measurements are to be considered from the perspective of a market participant that holds the asset or owes the liability. We also establish a FV hierarchy which requires an entity to maximize the use of observable inputs and minimize the use of unobservable inputs when measuring FV.
The Company evaluates embedded conversion features within convertible debt under ASC Topic 815, "Derivatives and Hedging," to determine whether the embedded conversion feature should be bifurcated from the host instrument and accounted for as a derivative at FV with changes in FV recorded in earnings. If the conversion feature does not require derivative treatment under ASC 815, the instrument is evaluated under ASC subtopic 470-20, "Debt with Conversion and Other Options," for consideration of any beneficial conversion feature.
Reclassifications — Certain reclassifications were made to the prior period amounts disclosed in the consolidated financial statements to conform to the presentation form the three and six months ended September 30, 2013. These reclassifications had no effect on reported net loss or stockholders' equity.
Recent Accounting Pronouncements – There were no significant changes in the Company's critical accounting policies and estimates during the three and six months ended September 30, 2013 compared to what was disclosed in the Company's Annual Report on Form 10-K for the year ended March 31, 2013.
The unaudited consolidated financial statements were prepared by us pursuant to the rules and regulations of the Securities and Exchange Commission ("SEC"). The information furnished herein reflects all adjustments (consisting of normal recurring accruals and adjustments) which are, in the opinion of management, necessary to fairly present the operating results for the respective periods. Certain information and footnote disclosures normally present in annual consolidated financial statements prepared in accordance with US GAAP was omitted pursuant to such rules and regulations. These consolidated financial statements should be read in conjunction with the audited consolidated financial statements and footnotes for the year ended March 31, 2013 included in our Annual Report on Form 10-K. The results of the three months ended June 30, 2013 are not necessarily indicative of the results to be expected for the full year ending March 31, 2014.
Foreign Currency Transactions — The Company recognizes foreign currency gains and losses in other income (expense) on the accompanying statement of operations. Foreign currency gains and losses arise as the Company conducts business with other entities whose functional currency are not US dollars. Generally, these gains and losses are recorded at an exchange rate difference between the foreign currency and the functional currency that arises between the transaction date and the payment date.
As of September 30, 2013 and March 31, 2013, an affiliated party, Timeway International Ltd, holds in trust $55,612 and $54,418, respectively. This money is used to pay various day to day expenses. Timeway International Ltd is controlled by our Chief Executive Officer.
As of September 30, 2013 and March 31, 2013, $603,503 and $412,615, respectively, is owed to the officers and directors of the Company. In December 2012, the officers and directors of the Company agreed to accrue compensation for their services until such time the Company had sufficient funds to pay this liability.
We entered into an agreement with Beijing Pengchuang Technology Development Co., Ltd. ("Pengchuang"), an independent Chinese company, to purchase 50% of the intellectual property related to ultrafine particle processing. Pengchuang developed a highly efficient and low energy consumption grinding technology, which utilizes fluid shock waves to make ultrafine particles. This technology can be applied to the coal water slurry, solid lubricant and other material grinding processes. Through a joint development and ownership agreement, AuraSource will enrich its intellectual property portfolio, enabling the further development of AuraCoal, its HCF technology. Qinzhou will utilize the particle grinding technology in its AuraCoal Qinzhou production line, as well as license it to others in non-related industries.
We issued 600,000 shares of common stock for the acquisition of certain intangibles. The shares issued in connection with $753,530 of the acquired intangibles were valued at $606,000 or $1.01 per share which was the share price on August 8, 2010, the acquisition date. The Company paid cash for the remainder of the amount due. The Company recorded $11,765 and $23,531 in amortization expense in the three and six months ended September 30, 2013, respectively, and $0 for the same periods in 2012.
In January 2009, we granted 60,000 options to purchase shares of our common stock at $3.50 per share to members of our BOD. In April 2010, we granted an additional 60,000 options to purchase shares of our common stock at $1.00 per share to members of our BOD. The options vest quarterly and have an expiration period of 10 years. In April 2011, we granted an additional 60,000 options to purchase shares of our common stock at $0.75 per share to certain members of our BOD. The options vest quarterly and have an expiration period of 10 years. In February 2012, we granted an additional 2,850,000 options to purchase shares of our common stock at $0.28 per share to certain members of our BOD. The options will vest upon the Company earning $5 million in revenues. The options expire in 5 years. In April 2012, we granted an additional 60,000 options to purchase shares of our common stock at $0.27 per share to certain members of our BOD. In April 2013, we granted an additional 60,000 options to purchase shares of our common stock at $0.45 per share to certain members of our BOD. The total grant date FV of the outstanding options was $810,722.
We will record stock based compensation expense over the requisite service period, which in our case approximates the vesting period of the options. During the three and six months ended September 30, 2013 and 2012, the Company recorded $3,462, $6,924, 3,595 and $7,190 in compensation expense arising from the vesting of options, respectively. The Company assumed all stock options issued during the quarter will vest. Though these expenses result in a deferred tax benefit, we have a full valuation allowance against the deferred tax benefit.
The Company adopted the detailed method provided in FASB ASC Topic 718, "Compensation – Stock Compensation," for calculating the beginning balance of the additional paid-in capital pool ("APIC pool") related to the tax effects of employee stock-based compensation, and to determine the subsequent impact on the APIC pool and Consolidated Statements of Cash Flows of the income tax effects of employee stock-based compensation awards that are outstanding.
The fair value of each stock option granted is estimated on the grant date using the Black-Scholes option pricing model ("BSOPM"). The BSOPM has assumptions for risk free interest rates, dividends, stock volatility and expected life of an option grant. The risk free interest rate is based upon market yields for United States Treasury debt securities at a 7-year constant maturity. Dividend rates are based on the Company's dividend history. The stock volatility factor is based on the last 60 days of market prices prior to the grant date. The expected life of an option grant is based on management's estimate. The fair value of each option grant, as calculated by the BSOPM, is recognized as compensation expense on a straight-line basis over the vesting period of each stock option award.
On January 25, 2013, the Company entered into a broker transportation agreement with M&L Logistics, Inc. to arrange transportation of minerals for various carriers, consignors or consignees for one year. This agreement can be terminated at any time upon notice by either party. As of September 30, 2013 and March 31, 2013, these deposits were recorded as shipping deposits.
On February 9, 2012, we entered into an agreement with Gulf Coast Holdings, LLC ("GCH"), an affiliate with over 10% voting rights, to reserve export ready one million tons of 64% Fe higher content iron ore, 13 million tons of 45% grade lower content iron ore and two million tons of manganese ore, at $1.00 per ton. In lieu of cash, GCH agreed to accept shares of the Company common stock at $1.00 per share. In conjunction with this agreement, we issued five million shares of our common stock immediately and agreed to issue 11 million upon the successful completion of the first customer order of over $5 million (the "Mineral Deposit Shares") to GCH or its assigns. On February 19, 2012, GCH assigned 100% of its interest in the Mineral Reserve Agreement to Hong Kong Minerals Holdings, Ltd. ("HKMHL"). Success shall be defined as customer acceptance of order and final payment. To the extent a successful order does not occur, the unvested Mineral Deposit Shares shall be returned to our treasury and cancelled. The Company has no material prior relationship with GCH or HKMHL other than what is set forth above. To date, the Company has not achieved $5 million in revenue, as such the 11 million shares is being held by the Company. As of September 30, 2013, the Company has not obtained possession of the above noted minerals. As such, the issuance of the shares have been recorded as a charge to additional paid in capital and a credit to common stock at par value of $0.001 per share for a total of $16,000. GCH has the right to designate two members on the Board of Directors ("BOD"), one of whom is to be mutually agreed. To date GCH has not designated any board members. Additionally, we entered into an agreement with Gulf Coast Mining Group, LLC ("GCM") to purchase minerals which will be delivered loose in bulk modified FOB. We entered into an agreement with GCH appointing GCH as the exclusive North American licensee for use and exploitation of our technology as it relates to applications involving precious metals in exchange for royalty payments of 5% of gross revenues. In August 2012, the Company made prepayments of $525,000 for delivery of minerals.
We maintain our cash balances in financial institutions that from time to time exceed amounts insured by the FDIC (up to $250,000, per financial institution as of September 30, 2013). As of September 30, 2013 and March 31, 2013, our deposits did not exceed insured amounts. We have not experienced any losses in such accounts and we believe we are not exposed to any credit risk on cash.
Currently, we maintain a bank account in China. This account is not insured and we believe is exposed to credit risk on cash.
The depreciation expense for the three and six months ended September 30, 2013 was $40,208 and $80,418, respectively. Depreciation expense for the three and six months ended September 30, 2012 was $7,369 and $7,616 respectively. The Company attributed $65,186 and $0 of such depreciation expense in 2013 and 2012, respectively, to R&D expense.
As of September 30, 2013 and March 31, 2013, the deferred revenue was zero and $63,754, respectively. This represented amount received from a customer for an order that was completed in September 2013.
As of September 30, 2013 and March 31, 2013, loans payable were $152,125 and $0, respectively. In June 2013, the company issued 275,783 common shares as a finance charge for the $108,382 of the borrowed amount and recorded $124,102 expense incurred in connection with the loan. The loan is due on demand.
The loans payable to related party were $95,716 and $0, respectively. In June 2013, the Company issued 162,180 common shares as a finance charge for $63,102 of related party loan and recorded $72,981 expense in connection with the loan. This loan is due on demand.
On December 31, 2012, the Company received $500,000 from Pelican Creek, LLC (Pelican Creek"), an unrelated party, and recorded the corresponding note as a current liability on the balance sheet. As an inducement to receive this loan, the Company issued 1,250,000 shares of its common stock to Pelican Creek. The FV of the shares issued was $812,500 valued at $0.65 per share, using the closing price on the effective date of the agreement. See Note 13, Stock Issuance, for further details. The coupon interest on this note accrues daily on the outstanding principal amount at 8% per annum. As such, as of September 30, 2013, the Company accrued interest of $30,000 and recorded it as part of the accounts payable and accrued expenses account. The Company finalized the terms and conditions of this payment on June 7, 2013.
On April 5, 2013 the Company entered into a Securities Purchase Agreement ("SPA") with Asher Enterprises, Inc. ("Asher"). Under the terms of the SPA, the Company issued to Asher a convertible promissory note of $63,000. The note had a nine month maturity date from issuance. The note bears interest at 8%. Any principal or interest on this note which is not paid when due shall bear interest at 22% from the due date until paid. The conversion price shall equal the variable conversion price, 61% multiplied by the market price (representing a discount rate of 39%). Market price is the average of the lowest three trading prices for the common stock during the ten trading day period ending on the latest complete trading day prior to the conversion date. This note had beneficial conversion feature ("BCF") of $40,279 and was recorded in the balance sheet at face value less the unamortized BCF. On September 20, 2013 the Company paid off this note for $87,345.
On July 19, 2013 the Company entered into an SPA with Asher. Under the terms of the SPA, the Company issued to Asher a convertible promissory note of $37,000. The note had a nine month maturity date from issuance. The note bears interest at 8%. Any principal or interest on this note which is not paid when due shall bear interest at 22% from the due date until paid. The conversion price shall equal the variable conversion price, 61% multiplied by the market price (representing a discount rate of 39%). Market price is the average of the lowest three trading prices for the common stock during the ten trading day period ending on the latest complete trading day prior to the conversion date. This note had BCF of $23,975 and was recorded in the balance sheet at face value less the unamortized BCF.
On September 20, 2013 the Company entered into an SPA with Todd Andis ("Andis"). Under the terms of the SPA, the Company issued to Andis a convertible promissory note of $90,000. The note had a six month maturity date from issuance. The note bears interest at 8%. Any principal or interest on this note which is not paid when due shall bear interest at 22% from the due date until paid. The conversion price shall equal the variable conversion price, 61% multiplied by the market price (representing a discount rate of 39%). Market price is the average of the lowest three trading prices for the common stock during the ten trading day period ending on the latest complete trading day prior to the conversion date. This note had BCF of $57,541 and was recorded in the balance sheet at face value less the unamortized BCF.
The amortization expense on the discount of BCF for these notes for the three and six months ended September 30, 2013 was $18,542 and $31,299 and was recorded as interest expense. The accrued interest as of September 30, 2013 was $797.
During the year ended March 31, 2013, the Company issued 1,250,000 shares of common stock in connection with finance charges to enter a note payable agreement in the amount of $500,000 and 817,250 shares of common stock as interest for delaying repayment of the balances due to related parties for services rendered. The total expense for such common shares issued during the year ended March 31, 2013 was $1,261,988. The Company issued 612,500 shares for $0.40 per share. The company recorded net proceeds from the sale of these shares of $245,000. On June 11, 2012, the BOD granted 60,000 shares for services in connection with fund raising activities, all of which vested immediately and were valued at $13,200.
During the six months ended September 30, 2013, the Company issued 437,963 shares of common stock as finance charge for loans to related and unrelated parties. For further details refer to Note 10, Loans Payable. On April 12, 2013, the Company agreed to issue 1,250,000 shares as a settlement for an advance from a customer in amount of $500,000.
In the three months ended June 30, 2012, the Company agreed to purchase certain minerals from HKMHL for $50,000. The $10,000 as of March 31, 2013 represents a payment towards that purchase. In the three months ended September 30, 2013, the Company purchased additional inventory for $32,580.
As of March 31, 2013, we had received $500,000 and $70,000 from two customers, respectively, to be applied towards the purchase of various minerals by those customers. As of September 30, 2013, the balance of such advances was $70,000. On April 12, 2013, the Company issued 1,250,000 shares of common stock for the settlement of the $500,000 customer advance.


text:
HIV/AIDS is considered the deadliest epidemic in the 21st century. It is transmitted through sex, intravenous drug use and mother-to-child transmission. Zambia is experiencing a generalized HIV/AIDS epidemic, with a national HIV prevalence rate of 11.3% among adults ages 15 to 49 as of 2018. Per the 2000 Zambian census, the people affected by HIV/AIDS constituted 15% of the total population, amounting to one million, of which 60%  were women. The pandemic results in increased number of orphans, with an estimated 600,000 orphans in the country. It was prevalent more in urban areas compared to rural and among all provinces, Copperbelt Province and Lusaka Province had higher occurrence.

The government of Zambia created an AIDS surveillance committee as early as 1986, and created an emergency plan to control the spread by 1987. By 2005, the government made antiretroviral therapy free for every individual. There are several UN and NGO voluntary organizations that are helping combat the disease.

Background

Human immunodeficiency virus infection and acquired immune deficiency syndrome (HIV/AIDS) is a set of conditions caused by infection with the human immunodeficiency virus (HIV). HIV is transmitted by three main ways: sexual contact, significant exposure to infected body fluids or tissues, and from mother to child during pregnancy, delivery, or breastfeeding (known as vertical transmission). There is no risk of acquiring HIV if exposed to feces, Nasal secretions, saliva, sputum, sweat, tears, urine, or vomit unless these are contaminated with blood. It is possible to be co-infected by more than one strain of HIV—a condition known as HIV superinfection.

Zambia is a landlocked, economically backward county in Africa. It is rated 166th in Human Development Index in 2006 out of a total of 177 countries based on the Human Development Report of the United Nations. By the end of 2006, a total of 39.5 million people in the world were infected by HIV and 2.9 million people died on account of ailments arising out of AIDS. Africa is the leader in AIDS with close to 60% of HIV victims and has been the leading cause of death in Africa.

Statistics
As per the 2000 Zambian census, the people affected by HIV or AIDS constituted 15 per cent of the population, amounting to one million, of which 60% estimated were women. The pandemic results in increased number of orphans, with an estimated 600,000 orphans in the country. It is estimated that by 2014, 974,000 children would be orphaned. The victims are high in Lusaka and Copperbelt provinces in spite of the provinces being the most urban. As per the estimate from 2006, the HIV positive cases is 5 per cent in the age group 15–19 years, 25 per cent from 30–34 years and 17% from 45–49 years. HIV was more prevalent in urban areas compared to rural areas.

Causes
The primary modes of HIV transmission are through sex, intravenous drug use and mother-to-child transmission. HIV prevalence rates vary considerably within the country. Infection rates are highest in cities and towns along major transportation routes and lower in rural areas with low population density. HIV prevalence among pregnant women can range from less than 10 percent in some areas to 30 percent in others. In general, however, young women ages 25 to 34 are at much higher risk of being infected by HIV than young men in the same age group. The prevalence rates are 12.7 and 3.8 percent, respectively. Risk for the disease is higher for people with sensory, intellectual, physical and psychosocial disabilities, despite the 2012 Persons with Disabilities Act. Other at-risk populations include military personnel, people in prostitution, truck drivers, and people who work in fisheries. Although men who have sex with men have a higher risk of HIV transmission than those who do not, the government-operated National AIDS Control Program does not address same-sex relationships. While Zambia's national prevalence rate remains high and shows no sign of declining, the country has been noted for its significant increases in antiretroviral treatment (ART) access.

Measures
The government of Zambia created an AIDS surveillance committee as early as 1986 and created an emergency plan to control the spread by 1987. As per the plan, all blood transfusion should be screened for HIV. By 2002, the government created a mission to make antiretroviral therapy available for every individual. By 2005, the government made antiretroviral therapy free for every individual.

With about one million Zambians living with HIV/AIDS and 200,000 of these persons requiring ART, the Government of the Republic of Zambia has prioritized making ART available to all Zambians in need. A 2006 rapid assessment of the Zambian ART program identified several important constraints including: inadequate human resources for counseling, testing, and treatment-related care; gaps in supply of drugs in the public sector; increase in value of the Zambian kwacha; lack of adequate logistic/supply chain systems; stigma that hinders people from seeking treatment and care; lack of information on the availability of treatment services; a high level of misinformation about ART; need for a continuous funding stream as an accumulation of patients on ART results in a growing need for support; high cost of ART to patients, despite subsidies from the public sector; lack of referral between counseling and testing services and ART; and lack of referral between home-based care services, testing and ART.

See also
ZAMBART Project

Notes

References

 f

Further reading
 Children as Caregivers: The Global Fight Against Tuberculosis and HIV in Zambia by Jean Hunleth, 2017, Rutgers University Press

Zambia
Zambia
Health in Zambia


text:
…Inside: I I Baseball Special See Page 9 Ninety-four Years Milky ofSFV Editorial Freedom More clouds, with a high of about 43 degrees. Vol XCIV-No. 140 Copyright 1984, The Michigan Daily Ann Arbor, Michigan - Tuesday, March 27, 1984 Fifteen Cents Ten Pages Police break Tarple up brawl at Taco Bell By SUE BARTO Ann Arbor police officials broke up a fight between more than 20 persons, most of them students, at the Taco Bell restaurant on...…
…al Page 2 - The Michigan Daily - Tuesday, March 27, 1984 Candidates get set for primary in Connecticut IN BRIEF From the Associated Press On the eve of the Connecticut primary, Gary Hart accused Walter Mondale yesterday of advocating a Central American policy that would lead to U.S. bloodshed in the region, while the Rev. Jesse Jackson promised to end poverty in America in three years by diverting funds earmarked for weapons. The three Demo...…
…City council delays homeless shelter vote The Michigan Daily - Tuesday, March 27, 1984 - Page 3 ACLU forms committee to review code By ERIC MATTSON The Ann Arbor City Council voted last night to table a proposal which would allow a $25,000 down payment on the controversial shelter for the city's homeless. Council members voted 6-3 to post- pone the decision until their April 5 meeting. SPONSORS of the decision to table the measure said they...…
…a OPINION Page 4 Tuesday, March 27, 1984 The Michigan Daily 1a Conduct code no good to NO CODE! By Eric Schnaufer and Andrew Boyd NO CODE! is a slogan, a campus- wide movement, a comprehensive critique of the code, and a student organization. The following is an outline of the organization's critique of the proposed student code of nonacademic conduct and proposed {University judicial system, informally known as "the code." NO CODE...…
…The Michigan Daily - Tuesday, March 27, 1984-- page 5 AIDS carrier traced through homosexual chain NEW YORK (AP) - Forty cases of Acquired Immune Deficiency Syndrome in 10 cities have been traced through a chain of sexual contacts to a homosexual man who may have been a "carrier" of the disease, spreading it across the coun- try without knowing he had it. The man had sexual contact with eight victims of AIDS - fbur in Los Angeles and four in...…
…a Baseball vs. Grand Valley Doubleheader, 1:00 p.m. today Ray L. Fisher Stadium SPORTS Men's Tennis vs. Illinois Friday, 2:30 p.m. Track and Tennis Building Page 6 The Michigan Daily Tesday, March 27, 1984 Lakers By GARY EFFMAN The calls of Spring may finally be heard in Ann Arbor. The birds are singing, the Diag is buzzing, and once again the crack of the bat will be heard at Ray L. Fisher Stadium where the Wolverines will play host to t...…
…Final two The Michigan Daily - Tuesday, March 27, 1984 -Page 7 for Blue! (Continued from Page 1) Joubert did just that holding the 6-4 sophomore to eight second-half points. "Number eleven did a heck of a job on him," said Moir. "With his size, he did a much better job than I anticipated he would." BESIDES Curry, another reason why the Wolverines fell behindby as many as nine in the first half was the play of Eric Turner. The junior from Fli...…
…A Page 8 - The Michigan Daily - Tuesday, March 27, 1984 6 E FOR SALE USED 2.5 cu. ft. DORM-SIZE FRIDGE $75.00 GREAT CONDITION, CALL 769-9546 (leave message). 86B0331 BERNARD CAR - Drive carefully on your way to the Daily, where two tickets to the State Theatre are waiting for you. dB0327 ZONTA CLUB - Rummage sale March 30 and 31, armory. Rummage needed - 668-8274. 05B0329 1976 VOLVO, 242 DL. Southern car. Air conditioned, sunroof, 5 speed...…
…The Michigan Doily - Tuesday, March 27, 1984 - Page 9 MICHIGAN BASEBALL '84 Blue barbecued in mu J By CHRISTOPHER GERBASI in 1983, Michigan's baseball team roared through March like a lion, win- ning eleven of their first twelve games on the way to one of the school's most successful seasons ever. On this year's spring trip to Edin- burg, Texas, the Wolverines played more like lambs, stumbling to a 3-7 start. THE DIFFERENCE? Pitching, ...…
…6 Page 10 - The Michigan Daily - Tuesday, March 27, 1984 DEFENDING CHAMPION.TEXAS THIRD AS i By JOE EWING If you took a look at the current college baseball rankings, you would think that the University of Michigan was located somewhere in the south or southwest and that its baseball team has already won at least 20 games this year. Or at least that's the impression you would get from the company that the Wolverines keep in the ratings. ACC...…


text:
\section{Conclusion}

In this paper we introduced CoachNet, where a predictor is first trained to predict the difficulty of scenarios for the RL agent and such predictions are in turn used to guide sampling for RL training to focus on the more challenging trajectories. We showed that agents thus trained for an equal number of time steps achieve higher average reward and lower number of failures at test time in comparison to agents trained with the vanilla Monte Carlo sampling method.

While we studied the effect of CoachNet on the performance of PPO, it should be obvious that the CoachNet method can be combined with other RL algorithms as well. For example, a transition-level predictor (as versus trajectory-level predictor) can be similarly constructed to prioritize samples in a replay buffer used by many RL algorithms. In addition, while we used CoachNet in an adversarial sampling setting, it can also be used for online monitoring and risk estimation.

There are also various ways of extending the CoachNet architecture. We are currently working on using CoachNet to generate adversarial scenarios for potentially even more efficient training of RL agents with robust performance. Moreover, failures come in different kinds, an autonomous car or a service robot may indeed have to differentiate crashes that destroys itself and crashes that also kill humans. While we treated CoachNet as predictor of undifferentiated failure, we can extend it to admit multiple classes of failures so as to enable intelligent trade-offs among different types of failures as well as with reward accumulation.

The specific training setup for this first version of CoachNet exploits the strong correlation between initial states and final outcome where the episodes are short. However, this basic idea of CoachNet can be generalized to long episodes and continuous cases so long as a relevant temporal horizon can be established. In autonomous driving, for example, even though going from A to B may take hours, the temporal horizon for safety-critical decision typically does not exceed 10 seconds. Robotic manipulation and robot locomotion have similar temporal regularity that can be exploited. More generally, where highly variable temporal horizons are relevant for the same task, we could employ multiple concurrent predictors trained with RL-style learning algorithm~\cite{sutton2011horde} to make relevant predictions based on a short sequence of steps happening at any time, rather than just at the beginning of short episodes.

\section{Experimental Results}
We evaluate the performance of the proposed adversarial sampling method on three continuous control environments in Roboschool \cite{schulman2017proximal} including RoboschoolHopper-v1, RoboschoolHalfCheetah-v1, and RoboschoolWalker2D-v1, as shown in Figure~\ref{fig:envs}. We used the forward walker reward to keep things simple.
While the proposed method does not make any assumptions on the RL algorithm used for training the agent and can be applied to any RL pipeline, we build our algorithm on Proximal Policy Optimization (PPO) \cite{schulman2017proximal} for the sake of evaluation in this section. PPO was selected for RL training as it has demonstrated reasonable performance across environments used in this paper. The objective is to investigate the effect of the CoachNet guided sampling method on the performance of the chosen RL algorithm.

\begin{figure}[hbt!]
	\centering
	\includegraphics[scale=0.5]{sections/figs/environments_placeholder.png}
	\caption{\textbf{Continuous Control Environments:} left-to-right: the RoboschoolHopper, RoboschoolWalker2D, RobochoolHalfCheetah}
	\label{fig:envs}
\end{figure}
\vspace{-10pt}
\subsection{CoachNet}
In this section, we asses the performance of CoachNet in predicting agent's failure in different environments. We also compare the proposed architecture to a feed-forward network which does not have the state-predictor component. Failures are defined by the standard termination criteria of each environment so as to make the experiments reproducible.

For each environment, the agent was trained for 200k timesteps. A publicly available implementation of PPO \cite{stable-baselines} was employed, and the default parameters provided in \cite{schulman2017proximal} was used for agent training. To train CoachNet, we used the same data used for training of the RL agent. We trained the agent until it reached to a certain performance in terms of the average episode reward, after which we started collecting data for training CoachNet. As mentioned in Section 3.1, in order to get more samples from the failure cases, we used the continuation approach to train CoachNet. Also, since the number of failed episodes is less than the number of successful episodes, we used a subset of data to avoid the imbalanced training data problem. To this end, the collected data was sampled using two criteria, giving more priority to more recent data and keeping the ratio of the number of failure cases to the total number of scenarios between 0.3 and 0.7.

Five initial states were fed as inputs to CoachNet, and the agent's age was used as the agent-dependent parameter.

We investigated two sets of architectures for CoachNet; one with state-predictor and one without state-predictor, hereafter referred to as CoachNet-WSP and CoachNet-MLP, respectively. For state prediction in CoachNet-WSP a two-layer LSTM \cite{gers1999learning} with [1024, 512] units and a one layer neural network with the same number of units as the environment's states was used in an RNN cell. A multi-layer feed-forward network was also adopted for failure predictor component in both CoachNet-WSP and CoachNet-MLP architectures. For CoachNet-WSP we used layers with [1024, 512] units and for CoachNet-MLP the network has [1024, 512, 256, 128] units. We tried different settings and chose the one with better performance. For example, increasing the capacity of CoachNet-MLP resulted in over-fitting so we avoided bigger networks.

Table~\ref{table:fspresults} summarizes the evaluation result of CoachNet on 100 seeds. Instead of precision and recall, which are commonly used in supervised learning, we report the average probability of failure and success for successful and failed trajectories on all of the environments as these numbers directly affect the sampling performance. As mentioned in Section\ref{sec:adv-sampling} the probability of accepting a trajectory is a function of the probability of failure predicted by CoachNet.
The result shows that CoachNet-WSP outperforms the CoachNet-MLP architecture in all of the locomotion tasks. We believe that the role of the state predictor becomes more crucial when dealing with more dynamic environments as it can better model the agent's dynamics.

\begin{table*}
	\footnotesize
	\begin{center}
		\begin{tabular}{cc||cccc||cccc||cccc}
			&& \multicolumn{4}{c||}{RoboschoolHopper-v1} & \multicolumn{4}{c||}{ RoboschoolHalfCheetah-v1}& \multicolumn{4}{c}{RoboschoolWalker2D-v1}\\
			\cline{3-14}
			\multicolumn{2}{c||}{Algorithms} & \multicolumn{2}{c}{Failure} & \multicolumn{2}{c||}{Success} & \multicolumn{2}{c}{Failure} & \multicolumn{2}{c||}{Success} & \multicolumn{2}{c}{Failure} & \multicolumn{2}{c}{Success} \\
			\hline
			\multicolumn{2}{c||}{CoachNet-WSP} & \multicolumn{2}{c}{0.88} & \multicolumn{2}{c||}{0.19} & \multicolumn{2}{c}{0.97} & \multicolumn{2}{c||}{0.14} & \multicolumn{2}{c}{0.84} & \multicolumn{2}{c}{0.25} \\
			\multicolumn{2}{c||}{CoachNet-MLP} & \multicolumn{2}{c}{0.65} & \multicolumn{2}{c||}{0.41} & \multicolumn{2}{c}{0.73} & \multicolumn{2}{c||}{0.32} & \multicolumn{2}{c}{0.57} & \multicolumn{2}{c}{0.49} \\

		\end{tabular}
	\end{center}
	\vspace{-5pt}
\caption{Results of failure prediction by CoachNet-WSP and CoachNet-MLP tested on 100 seeds. The average probability of failure is reported on both failed and successful scenarios. In both of these scenarios CoachNet-WSP has a better performance in all environments.}
\label{table:fspresults}
	\vspace{-10pt}
\end{table*}

\subsection{Adversarial Sampling Method}
In this section, we evaluate the impact of the proposed adversarial sampling method on the performance of the RL algorithm. We trained two sets of agents; one uses the conventional vanilla Monte Carlo sampling method and another one uses the proposed adversarial approach. For this experiment, we restored the weights of the trained agents in the previous section as initialization to resume the training. We also fine tuned CoachNet after every 400k timesteps. We found this step to have a minor effect on the agent's performance. However, we believe that the effect will be more tangible if the task is more difficult and if the behavior of the agent changes more significantly during the second phase of the optimization.

We trained both agents on one million time steps. The average episode reward is shown in Figure~\ref{fig:training-rew}. In all of the locomotion tasks, training with adversarial sampling approach has resulted in lower average reward during the training. This behavior is expected as CoachNet intentionally guides the agent to harder scenarios. The difference become smaller as the agent gets trained on the adversarial trajectories.

\begin{figure}[b!]
	\centering
	\vspace{-20pt}
	\includegraphics[scale=0.3]{sections/figs/training_reward.pdf}
	\vspace{-20pt}
	\caption{Comparison of the training time average reward between vanilla Monte Carlo (VMC) vs. Adversarial Sampling (ADV) .}
	\label{fig:training-rew}
	\vspace{-15pt}
\end{figure}

\begin{figure}[hbt!]
	\centering
	\vspace{-20pt}
	\includegraphics[scale=0.3]{sections/figs/avg_testtime_failures.pdf}
	\vspace{-20pt}
	\caption{Comparison of the test-time average reward between VMC vs.ADV. Tested with 50 random seeds.}
	\label{fig:eval-fail}
	\vspace{-15pt}
\end{figure}

\begin{figure}[hbt!]
	\centering
	\vspace{-10pt}
	\includegraphics[scale=0.3]{sections/figs/avg_testtime_rew.png}
	\vspace{-20pt}
	\caption{Comparison of the test-time average episode reward between VMC vs.ADV. Tested with 50 random seeds.}
	\label{fig:eval-rew}
	\vspace{-15pt}
\end{figure}

In order to evaluate the performance of the agents trained with these two approaches, we stored the agent model in every 50k timesteps. We then evaluate each agent on 50 seeds. Figures~\ref{fig:eval-fail}~and~\ref{fig:training-rew} show the average number of failures and episode reward for each agent, respectively. As shown in Figure~\ref{fig:eval-fail}, the number of failures are almost halved for agents trained using the adversarial approach compared to those of agents trained using VMC sampling method. Figure~\ref{fig:eval-rew} also shows the similar result in all of three environments. As can be seen from the figure, the average reward of the evaluation is higher after 500k timesteps for the agents trained using the proposed method.

\section{Introduction}
Despite the great success of reinforcement learning (RL) in games and robotics \cite{silver2017mastering}, \cite{OpenAI_dota}, \cite{andrychowicz2018learning}, applying it to real-world problems has remained challenging. Efficiently generating enough amount of meaningful training scenarios and robust performance of the deployed agents especially in presence of rare events are open problems in this area.

The vanilla Monte Carlo approach of randomly sampling states is the standard way of training RL agents \cite{schulman2015trust}, \cite{lillicrap2015continuous}, \cite{haarnoja2018soft}. There are a few problems with this approach.

First, much training is devoted to unnecessary repetition. As an agent starts to learn a task, it predictably fails often. As learning progresses, frequency of failures is expected to drop, but some scenarios could remain challenging for a lot longer. However, because the default approach fails to consider the agent's performance, the RL agent may repeatedly encounter scenarios it already mastered, leading to negligible progress. The RL training consequently becomes unreasonably data hungry.

Second, rare challenges are under-represented in the samples. As training progresses, hard examples become more difficult to find in piles of scenarios that the agent can easily solve. This gives the agent little chance to encounter the rare but informative (for training efficiency) and important (for robustness) failures. In safety critical situations, such as autonomous driving where the cost of a single crash outweighs millions of kilometers of flawless operation, the incommensurately large cost of failure means that there is no tightly bounded reward. Such considerations suggest that exploration guided by the current estimate of expected return tend to be overly neglectful of domain shifts and overly optimistic about absence of critical failures, leading to selection of unreliable solutions for test or deployment \cite{zhao2019investigating}.

Third, the exploration-exploitation tradeoff is left to the RL optimization algorithm alone. While it is reasonable to expect the RL algorithm itself to be smart about the trade-off between exploration and exploitation, it is unreasonable to expect it to do all the work. Intrinsic guidance may only go so far. Smart as we humans are, external help is often needed to push us out of our comfort zone (a.k.a. suboptimal region) so that we can explore towards another level of performance. Architecturally speaking, we could systematically take advantage of the difference between training time and test time to ensure adequate exploration, especially if training is done in simulators or safe environments \cite{andrychowicz2018learning}.

Taking inspiration from the psychology of deliberate practice \cite{ericsson1993role}, we propose \textit{CoachNet} guided sampling method to address the above limitations of the default sampling approach. CoachNet predicts the difficulty of an episode \textit{for a specific version of the RL agent} based on the very first few steps of the episode. Difficulty here is defined as the probability of subsequent failure if the episode is allowed to continue. Predictions from the CoachNet can then be used to probabilistically terminate and reject an episode if it is predicted to be easy, or allow it to finish and contribute to parameter updates of the RL agent if it is predicted to be hard. This way, instead of repeating scenarios that the agent has already mastered, training is deliberately focused on the agent's ``weak spots''. Moreover, failures are negatively correlated with the reward signal. If they are under-represented they potentially can have a catastrophic impact on the robustness of the agent. Increased exposure to these failure cases is expected to enhance robustness of the trained agent. Finally, the CoachNet directs the exploration process extrinsically, i.e. from the outside of the RL optimization. This differentiates it from, for example, the critic in an actor-critic model, which could be used to guide the exploration intrinsically.

In what follows, we present the specifics of the design of CoachNet, discuss its underlying principles, and empirically demonstrate its effectiveness in improving sample efficiency and test-time robustness in common continuous control tasks. The main contributions of our paper are:

\begin{itemize}
	\item Introduction of CoachNet for predicting the agent's performance in an episode, which can be used to guide training;
	\item Empirical demonstration that CoachNet trained with self-labeled data from the RL training process can be used to effectively predict failures;
	\item Proposing an adversarial sampling method based on CoachNet where the RL agent is adaptively exposed to what is difficult for it, a method which can be added to any RL algorithm; and
	\item Empirical evaluation of this method on three continuous locomotion control tasks, demonstrating that with the same number of samples, the agent trained with CoachNet achieves higher average reward and lower number of failures.
\end{itemize}

\section{Related Works}

\textbf{Adversarial Reinforcement Learning} Our approach has an adversarial character because it deliberately directs the agent to scenarios that are more challenging for the agent. While adversarial learning for supervised computer vision models has been extensively researched since \cite{goodfellow2014explaining}, adversarial RL research is still in its early days. The robustness of DDQN~\cite{van2016deep} and DDPG in the presence of adversarial attacks were studied in~\cite{pattanaik2018robust} using search algorithm and SGD to find adversarial states. Then, adversarial noise was added to observations so as to make the policy choose the worst action (lowest Q values). However, this approach requires access to the state generator. In Robust Adversarial Reinforcement Learning (RARL) \cite{pinto2017robust}, a protagonist agent tries to fulfil the goal while an adversary agent tries to disrupt its performance. Fictitious Self-Play (FSP) from game theory has also been adapted to train the agent against adversaries~\cite{heinrich2015fictitious}. However, neither RARL nor FSP essentially demonstrates the variations of states in an actual environment. The work closest to ours is  \cite{uesato2018rigorous} which estimates the risk using a failure search method for evaluation.

\textbf{Sampling in RL} Among methods that regulate what the RL optimizer sees, \cite{schaul2015prioritized} used the the TD error to prioritize samples in the replay buffer. Under this approach, the agent still requires to experience the scenarios, store the transition tuples, and rank them. In contrast, our approach uses predicted performance to simply reject scenarios and avoids the generation of whole trajectories. Importance sampling was used in~\cite{frank2008reinforcement} to provide an unbiased and low variance solution assuming availability of probability of rare events. Moreover, adaptive importance sampling was employed in~\cite{schmerling2016evaluating} to evaluate the probability of collision for different trajectories generated by a motion planner. Both studies assumed prior knowledge of the environment.

\textbf{Exploration Strategy} Our method can also be viewed as an extrinsic exploration strategy. Thompson sampling \cite{kaufmann2012thompson} is commonly used in combination with RL algorithms to improve exploration. For example, \cite{haarnoja2017reinforcement} explicitly adds the policy entropy to the objective to ensure exploration. Noisy networks was used in~\cite{fortunato2017noisy} to improve exploration. Curiosity driven approaches \cite{pathak2017curiosity} are another family of exploration strategies which encourage the visitation of less visited states by giving the agent an intrinsic reward for the states with high prediction error. We believe these approaches are complimentary to our method.

\textbf{Connection with Supervised Learning} In the supervised learning framework, as training progresses it is very common to employ a mechanism to focus the training on examples that are still difficult for the model to classify \cite{galar2011review},~\cite{felzenszwalb2008discriminatively}. Such examples are either close to decision boundaries or from the less common classes. They are prioritized using their last-seen classification error. Although these ideas are simple and very effective in supervised learning, their possible usefulness in an RL context has so far been overlooked.

\section{Technical Approach}

In this section we describe the proposed method. First, we explain the architecture and training procedure for CoachNet in Section~\ref{sec:coachnet}. In Section\ref{sec:adv-sampling}, we propose a stochastic sampling approach using CoachNet's predictions to adversarially sample from the environment.

We consider the parametric Markov Decision Processes (MDP) \cite{sutton1998introduction}. An MDP is defined by a tuple $\langle S,\ A,\ R,\ T,\ \rho_0,\ \gamma \rangle$ consisting of a set of states $S$, actions $A$, a task dependent reward function $R(s,\ a)$, a transition function $T(s,\ a,\ s^\prime) = p(s^\prime|s,\ a)$, the initial state distribution $\rho_0$ and a discount factor $\gamma$. Trajectories $\tau$ are gathered according to the policy $\pi$. Given an MDP, the objective of RL is to learn a policy $\pi$ to maximize the expected sum of discounted reward $J_M(\pi) = \E_{\tau}[\sum_{t=0}^{\infty}{\gamma^t}r_t]$ where $r_t=R(s_t, a_t)$.

\subsection{CoachNet: Failure Predictor}\label{sec:coachnet}

The purpose of CoachNet is to predict the difficulty of a trajectory given the agent and its initial few interactions with the environment. In this paper, we employ failure prediction as a proxy for difficultly prediction. Failure is defined as termination (``done'') before a certain number of steps $H$ is reached.  For discussion, we call $H$ the ``prediction horizon'' corresponding to the limit that the CoachNet is able to predict given the task.

The initial training of CoachNet follows a simple scheme. We start with the standard RL training process and let the agent learns until it reaches a certain level of performance $R_{mean}$. After that, we start collecting training data for CoachNet by storing sequences of $(s_t,\ \phi_t)$ pairs, where $s_t$ is the state and $\phi_t$ encodes information about the agent at time $t$. Each sequence of $(s_t, \phi_t)$ pairs are tagged with $c$. $c$ is 1 if the agent fails in a trajectory of length $H$ and 0 otherwise. If termination happens before $H$ steps, the rest of sequence is zero-padded. After collecting $N$ such sequences, CoachNet is trained with this data. This process is summarized in Algorithm~\ref{alg:train-1}.

There are many choices for the specific architecture of the CoachNet. For our main experiments, we use two cascaded components, a state predictor and a failure predictor. The state predictor is a multi-layer RNN that gets first initial $l$ state-agent pairs and predicts the states for the rest of the prediction horizon $H$. Intuitively, the state predictor encodes the state transitions given a specific agent. In experiments we show how this component improves CoachNet's ability to predict failure. After $l$ steps, the RNN uses the output of each step to predict the next state. Agent parameters, initial states, and the predicted states are then fed to a multi-layer neural network that outputs the probability of failure. The architecture of the CoachNet is illustrated in Figure\ref{fig:coachnet}.

The network is trained end-to-end by minimizing the following loss
\vspace{1pt}
\begin{align}
	L = k_1L_1(\hat{S},\ S) + k_2L_2(\hat{c},\ c)
\end{align}
\vspace{1pt}
where $L_1$ is the mean-squared error of the state prediction $\hat{S}$ and $\hat{c}$ is the predicted failure, $L_2$ is the classification loss, and $k_1$ and $k_2$ are hyperparameters.

\begin{figure}[hbt!]
	\centering
	\vspace{-10pt}
	\includegraphics[scale=0.65]{sections/figs/coachnet.pdf}
	\caption{CoachNet Architecture. States and agent dependent parameters are fed to the state predictor. They then are stacked with predicted states and used as the inputs of feed-forward network to predict failure.}
	\vspace{-10pt}
	\label{fig:coachnet}
\end{figure}

The described training method is known as the continuation approach \cite{uesato2018rigorous}. It operates on the principle that versions of the agent from which we collect data throughout a possibly lengthy RL training process actually fail in correlated ways. The existence of such correlation makes it easier to populate failure cases in the collected data set because the agent usually fails more frequently in earlier stages of training. If failure modes of different versions of the agent were not correlate to each other, this approach could become ineffective. However, our experiments show that this is not the case in our task domains and CoachNet could decode the systematic relation between $\phi$ and $s$.

\vspace{-10pt}
\begin{algorithm}
    \caption{Stage 1 Training - Data Collection}
    \label{alg:train-1}
    \textbf{Input:} $N$ number of trajectories in first phase, $H$ prediction horizon \;
    \Repeat{$R_{mean} > threshold$}{Train the RL agent}
   	\For{n\ =\ 0\ :\ N}{
   		\For{k\ =\ 0 :\ H}{
   			Store data $(s_t, \phi_t)$\;
   			Train the RL agent\;
   			\If{done}{
   			Zero-pad the sequence\;
   			Tag the sequence with $c=1$ \;
   			Break\;
   			}
   		}
   		\If{not done}{
   			Tag the sequence with $c=0$ \;
   		}

    }

\end{algorithm}
\vspace{-10pt}
\subsection{Adversarial Sampling Method}\label{sec:adv-sampling}
Assuming CoachNet can be effectively trained with the setup in the previous section, we propose an adversarial sampling method that uses CoachNet's predictions to improve training over the default uniform sampling method.

A naive approach would be letting the agent experience a scenario for the initial $l$ steps and then applying the CoachNet to make a clearcut decision about whether to continue the episode according to a certain fixed threshold or not. This naive approach has several issues. First, because the CoachNet is an estimator, there is inevitably going to be error in its predictions, which could be large especially if it has not encountered some trajectories. Second, using CoachNet in a clearcut and exclusive way could also make the agent focus on only a small subset of trajectories, making the learning process prone to over-fitting. To deal with these issues, we propose using a stochastic sampling approach. Specifically, we use the rejection sampling method \cite{bucklew2013introduction}, where we accept a trajectory with the probability of $p_f$:
\vspace{1pt}
\begin{equation}
p_f = min(f^{\alpha}(s, \phi) + \mu, 1)
\end{equation}

Here, $\alpha\geq0$ is a hyperparameter that is used to exponentiate the raw prediction. It can be tuned to make up for underestimation or overestimation of the failure probability prediction. $\mu$ ($0<\mu\leq1$) is another hyperparameter which ensures every trajectory has a non-zero chance of being accepted. A summary of this approach is described in Algorithm~\ref{alg:adv-sampling}.

\begin{algorithm}
    \caption{Stage 2 - Training Using Adversarial Sampling}
    \label{alg:adv-sampling}
    \textbf{Input:} $N$ number of trajectories in second phase, $T$ trajectory length, $l$ length of initial states, $M$ period for online training of CoachNet \;
   	\For{n\ =\ 0\ :\ N}{%
	   \While{not done}{
	   		\Repeat{Accepting a trajectory}{
   	   		\For{k\ =\ 0\ :\ $l$}{
   	   	 		Collect data $(s_k, \phi_k)$\;
   	   	 	}
      		Compute $p_f$\;
      		Accept the trajectory with the probability of $p_f$\;
       	}

      \For{t\ =\ 0: T}{
      	Train the RL agent\;
      	Store data $(s_t, \phi_t)$\ for CoachNet;
      }
      \If{$(n \% M) == 0$}{
      	Fine-tune CoachNet with the new data \;
      }
  	}

     }
\end{algorithm}

\vspace{-10pt}
Once a scenario is accepted, the agent is allowed to continue the trajectory for up to an additional $T$ steps per settings of the original RL training. On the flip side, if a scenario is accurately rejected after seeing only the initial $l$ steps, it means about $T$ steps of interaction with the environment are saved. Given that $T>>l$, this could mean significantly more sample efficient training when most scenarios become simple for the agent.

Although our approach helps the agent experience difficult scenarios relatively more frequently, it also introduces a bias to the sampling in contrast to vanilla Monte Carlo sampling. We use a simple but practical approach to handle such a bias. Typical RL process is significantly non-stationary because of the changing policy and state distributions and thus unbiased updates is comparably much more important closer to convergence or to the end of training. Hence we use a schedule on $\mu$ to modulate the bias by gradually increase $\mu$ from an initial value $\mu_0$ to 1 to allow a smooth transition to vanilla Monte Carlo sampling. Note that this schedule is well aligned with the proposed system. As we train the agent with more adversarial samples and train CoachNet in an online fashion, the agent gets more robust and the probability of failure gets closer to 0 for most of the scenarios.
\footnote{An alternative way of dealing with this bias is to use importance sampling \cite{bucklew2013introduction} weights in the RL optimization step. This approach requires computing failure probability for all sampled transitions, which could be very difficult in continuous cases and in general computationally expensive. A potentially better approach is to estimate failure probability density ratios of whole trajectories solely based on the initial $l$ states. This is a potential topic for further research.}

Yet another important aspect of our design is the continued fine-tuning of CoachNet with new data every M iterations. In this step we use all collected data in both stages. However, similar to the initial training of CoachNet the recent data is sampled with higher probability. As noted above, this helps keeping the CoachNet up to date as the agent's state visitation distribution changes along with the agent's policy.

redpajama_set_name: RedPajamaArXiv


People with migraines often report having light sensitivity (photophobia) accompanying their migraines. Others mentioned that light may be a trigger for some migraineurs. Sharing your light sensitivity experiences with others who understand what you are going through can be beneficial towards better managing the pain.
On MyMigraineTeam, the social network and online support group for those living with migraines, members talk about a range of personal experiences and struggles. Light sensitivity is one of the top 10 topics most discussed.
• Has anyone used TheraSpecs, if so what was your experience?
• Has anyone tried green LED lights for therapy for migraines?
• What kind of light bulbs do you use at home?
• A member shares her migraine experience and upcoming study medication.
• A member discusses how her migraine pain changed direction.
• A member asks if anyone has tried an anti-inflammatory diet to fight migraines?


text:
Winner, EFestival of Words 2013, Historical Fiction category.
Shortlisted, Writing Magazine Self-Publishing Awards, 2013.
Featured in "Off the Beaten Path" recommendations, Historical Novel Society Conference, 2013.
They drowned Victoire's mother, claiming she was a witch. Then her father died beneath the wheels of a nobleman's carriage.
Forced to leave her village, Victoire finds work in Paris. But domestic employment comes at a high price and the orphaned girl suffers gruesome abuse at the hands of a diabolical aristocracy.
Accused of a heinous crime, they imprison her in the depraved lunatic asylum, La Salpêtrière.
With the help of ruthless seductress, Jeanne de Valois –– conwoman of the Necklace Affair that brought down Marie Antoinette –– Victoire must find the strength to join the revolutionary force storming the Bastille.
Can she survive a chilling betrayal and rise above her impoverished peasant roots to take her place in this new, post-revolutionary France?
Based on historical fact, Spirit of Lost Angels is a riveting testament to the courage of women facing tragedy, betrayal and insanity in a world where their gift can be their curse.
Francophiles will want this one and those who enjoy historical fiction that doesn't focus on royals … Audra Book Blogger, Unabridged Chick.
Seven decades after German troops march into her village, Céleste Roussel is still unable to assuage her guilt.
1943. German soldiers occupy provincial Lucie-sur-Vionne, and as the villagers pursue treacherous schemes to deceive and swindle the enemy, Céleste embarks on her own perilous mission as her passion for a Reich officer flourishes.
When her loved ones are deported to concentration camps, Céleste is drawn into the vortex of this monumental conflict, and the adventure and danger of French Resistance collaboration.
As she confronts the harrowing truths of the Second World War's darkest years, Céleste is forced to choose: pursue her love for the German officer, or answer General de Gaulle's call to fight for France.
Her fate suspended on the fraying thread of her will, Celeste gains strength from the angel talisman bequeathed to her through her lineage of healer kinswomen. But the decision she makes will shadow the remainder of her days.
A woman's unforgettable journey to help liberate Occupied France, Wolfsangel is a stirring portrayal of the courage and resilience of the human mind, body and spirit.
1348. A bone-sculpted angel and the woman who wears it––heretic, Devil's servant, saint.
Midwife Héloïse has always known that her bastard status threatens her standing in the French village of Lucie-sur-Vionne. Yet her midwifery and healing skills have gained the people's respect, and she has won the heart of the handsome Raoul Stonemason. The future looks hopeful. Until the Black Death sweeps into France.
Fearful that Héloïse will bring the pestilence into their cottage, Raoul forbids her to treat its victims. Amidst the grief and hysteria, the villagers searching for a scapegoat, Héloïse must choose: preserve her marriage, or honour the oath she swore on her dead mother's soul? And even as she places her faith in the protective powers of her angel talisman, she must prove she's no Devil's servant, her talisman no evil charm.
Listen to Blog Talk Radio Interview
Listen to New Books In Literature Podcast
All eleven-year-old Tanya Randall wants is a happy family. But Mum does nothing besides housework, Dad's always down the pub and Nanna Purvis moans at everyone except her dog. Then Shelley arrives –– the miracle baby who fuses the Randall family in love for their little gumnut blossom.
Tanya's life gets even better when she meets an uncle she didn't know she had. He tells her she's beautiful and could be a model. Her family refuses to talk about him. But that's okay, it's their little secret.
Then one blistering summer day tragedy strikes, and the surrounding mystery and suspicion tear apart this fragile family web.
Embracing the social changes of 1970s Australia, against a backdrop of native fauna and flora, The Silent Kookaburra is a haunting exploration of the blessings, curses and tyranny of memory.
The thunderclap of sexual revolution collides with the black cloud of illegitimacy.
Sixteen-year-old Lindsay Townsend is pretty and popular at school. At home, it's a different story. Dad belts her and Mum's either busy or battling a migraine. So when sexy school-teacher Jon Halliwell finds her irresistible, Lindsay believes life is about to change.
She's not wrong.
Lindsay and Jon pursue their affair in secret, because if the school finds out, Jon will lose his job. If Lindsay's dad finds out, there will be hell to pay. But when a dramatic accident turns her life upside down, Lindsay is separated from the man she loves.
Events spiral beyond her control, emotions conflicting with doubt, loneliness and fear, and Lindsay becomes enmeshed in a shocking true-life Australian scandal. The schoolyard beauty will discover the dangerous games of the adult world. Games that destroy lives.
Lindsay is forced into the toughest choice of her young life. The resulting trauma will forever burden her heart.
Reflecting the social changes of 1970s Australia, The Swooping Magpie is a chilling psychological tale of love, loss and grief, and, through collective memory, finding we are not alone.
Review Quotes:
… each story is a jewel filled with interesting and provocative characters…
… in stories like Santa Never Came, and Daughter of Atlas, Perrat explores the layers and complexities of an immigrant nation, of different cultures coming together under a baking sun and learning to adapt to one another … not the Australia of Crocodile Dundee, but a much more nuanced country, one the rest of the world deserves to know better …
… lovely collection of insights into Australia, but be warned, you'll be Googling flights when you put it down. The author captures the atmosphere of a young, vast country, with unpredictable weather and huge space
These stories are of the Australia that you won't find in tour guides - a still young nation still trying to blend together from the mixed ingredients of immigrants from all over the world…


"Yes." He didn't move. Didn't even seem to breathe.
death." He looked back down at the computer, intensity pouring from him.
Denver, and he easily caught it before it smashed him in the face.
there. "What now?" she asked, her eyes gritty and her throat scratchy.
Her voice quivered, but she had to know.
His lip twisted. "I know I did." His tone was low with what seemed like self-hatred.
and I want death." He looked back down at the computer, intensity pouring from him.
pack at Denver, and he easily caught it before it smashed him in the face.
definitely there. "What now?" she asked, her eyes gritty and her throat scratchy.
I love Zanettis work and this cover makes me wnat it even more.
I love her work too!! I'm excited!


Usuthu have won four of their last five league encounters, which has seen them jump up to 10th spot. View The PSL Results. Here's how they line up: Polokwane: To be confirmed. Subs: AmaZulu: 28. Mbatha, 17. M.Gumede, 29. Mabaliso, 25. P.Gumede, 27.