text:
RNC Chair Calls For End to Trump Probe As Lines Harden Over Comey's Testimony
Jonathan Ernst
Partisan lines hardened on Sunday in the controversy over whether former FBI Director James B. Comey's compelling sworn testimony last Thursday accurately portrayed President Trump as a liar who sought to impede the federal probe of Russian meddling in the 2016 election or constituted a total exoneration of the president's conduct.
Trump escalated his attack on Comey's integrity and character this morning with a new tweet while a staunch GOP ally called for an immediate end to the congressional investigations into possible Trump campaign aides' collusion with the Russians and the president's subsequent efforts to block the FBI probe that was led by Comey before he was fired early last month.
Related: Why Trump Is Almost Certainly Bluffing When It Comes to Comey
At the same time, prominent Democrats and even some Republicans expressed confidence that Comey wouldn't intentionally lie in sworn testimony and demanded that Trump release evidence to back up his assertions that he never intentionally sought to block the investigation, including any surreptitious taping of his conversations with Comey that may have been made.
Sen. Lindsey Graham (R-SC), voiced alarm that the mushrooming controversy riveting Washington and the rest of the country is "more like a wrestling match than anything else" – one that is jeopardizing the GOP administration's agenda of health care reform, tax cuts, and new infrastructure.
"Here's the question: can you be a street fighter on all things all the time and still be a good president?" Graham said on the CBS News' Face the Nation. "My advice to the president is that every day you're talking about Jim Comey and not the American people -- and their needs and their desires and their hopes and their dreams -- you're making a mistake."
Comey's more than three-hour testimony before the Senate Intelligence Committee late last week transfixed the country as he described what he characterized as Trump's persistent, if oblique, efforts to get him to drop an FBI investigation of Trump's former national security adviser, Michael T. Flynn and Flynn's possible collusion with the Russians to influence the outcome of the election.
Related: The Only Person Who Can Bring Down Trump Is Sitting in the Oval Office
Comey accused Trump of firing him on May 9 over the Russian investigation after repeatedly failing to obtain the FBI chief's loyalty in the matter and then misleading the public about the reasons for doing so. He declared that Trump and his team told "lies, plain and simple" about him and the bureau's operations.
Trump lashed out at Comey on Friday during a news conference, disputing key segments of Comey's testimony -- but notably not those in which Comey confirmed that he had assured the president on three separate occasions that he was not currently a subject of the investigation. Trump told reporters he was willing to share his version of his private meetings with Comey with the special counsel overseeing the Russian investigation and hinted that he might have a tape of their conversations.
Trump tweeted again in the matter early this morning, this time denouncing Comey for behaving "cowardly" by leaking memos to the press detailing the two men's private conversations.
I believe the James Comey leaks will be far more prevalent than anyone ever thought possible. Totally illegal? Very 'cowardly!'
— Donald J. Trump (@realDonaldTrump) June 11, 2017
During one of those meetings – held in the Oval Office Feb. 14 after the president asked other participants to leave the room – Trump told Comey "I hope you can let this go," according to one of Comey's memos.
Within hours of this morning's presidential tweet, Republican National Committee chair Ronna Romney-McDaniel publicly called for a quick conclusion to the Senate and House Intelligence Committee investigations into whether Trump sought to obstruct the investigation of Russian meddling in the campaign. She contends that Comey's own testimony proved conclusively that Trump's isn't under investigation and that there is no evidence he hindered the investigation or colluded with the Russians.
Related: How the Comey Hearing Made America Great Again
"I'm calling for an end to the investigations about President Trump's campaign colluding with the Russians," she said on Fox News Sunday. "There's been no evidence of it. I don't think that should continue."
Romney-McDaniel's call for an end to the congressional probes -- as well as a speedy wrap-up to the investigation by Justice Department special counsel Robert S. Mueller III -- is, of course, wishful thinking. If anything, the Senate and House Intelligence Committees are just gaining momentum, while Democrats on the Senate Judiciary Committee are agitating for a bigger role in the obstruction of justice portion of the investigation.
Attorney General Jeff Session, a former Trump campaign adviser who had to recuse himself from the federal probe because of his own meetings with the Russian ambassador to the U.S. before and after the election, is scheduled to testify on Tuesday before the Senate Intelligence Committee.
Sen. Dianne Feinstein (D-CA), a member of the Senate Intelligence and Judiciary committees, stated flatly today that she found Comey far more believable than Trump on the question of whether the president intentionally tried to derail the investigation of Flynn's dealings with the Russians.
Related: Here's the Part of Comey's Testimony That Could Come Back to Haunt Him
"At this point, I believe the FBI director," Feinstein told Brianna Keeler of CNN. "I know him the best, I have observed him the longest, I know he has his own band of integrity," Feinstein said. "I disagreed with him on [his handling of the investigation of Hillary Clinton's emails] . . . but in this kind of thing, he's not going to lie. It's just not in him to do this."
Sen. Susan Collins (R-ME), a member of the Senate Intelligence Committee, said today that "the conversations [between Trump and Comey] should not have occurred, there is no doubt about it," but that there was a possibility Comey misinterpreted the president's expressions of concern for Flynn as a direct order to end the investigation.
While Collins believed the former FBI director's testimony was candid, she said she didn't understand why Comey didn't simply stand up to the president and say their conversations were inappropriate. Comey admitted during his testimony that he regretted he hadn't been tougher in standing up to Trump.
Constitutional Lawyer Denies Trump Is Being Investigated for Obstruction
One of the toughest jobs in Washington, going on two years now, has been appearing on political talk shows to defend...
Russia's Top Troll Strikes Again: Putin Offers Comey Political Asylum
While much of the world looks at the turmoil in Washington with apprehension and dread, at least somebody watching the...
Why Trump Is Almost Certainly Bluffing When It Comes to Comey
Unsurprisingly, just a day after former FBI director James Comey called President Trump a liar in testimony before...
Washington Editor and D.C. Bureau Chief Eric Pianin is a veteran journalist who has covered the federal government, congressional budget and tax issues, and national politics. He spent over 25 years at The Washington Post.


Kersten, Wolfgang und Meike Schröder. (2008) Regional Development: Qualification Measures as an Instrument of Regional Development - focusing the Logistics Field in the Metropolitan Region of Hamburg. Baltic Business and Socio-Economic Development 2007: 3rd International Conference Tallinn, Estonia, June 17-19, 2007. :576-595.
Kersten, Wolfgang, Meike Schröder, Carolin Singer und Max Feser. (2012) Risk Management in Logistics – Empirical Results from the Baltic Sea Region from 2010 until 2012. C.A.S.H. report.


text:
The Weeknd and Ariana Grande Announce New "Save Your Tears" Remix
April 21, 2021 by admin 0 Comments
The new version of the After Hours track drops this Friday, April 23
By Eric Torres
The Weeknd and Ariana Grande, December 2014 (Photo by Kevin Winter/Getty Images for iHeartMedia)
The Weeknd has announced a new remix of "Save Your Tears" featuring Ariana Grande. The new version of the After Hours track drops this Friday, April 23. Check out the Weeknd's announcement below.
The Weeknd has appeared on two Ariana Grande albums: My Everything ("Love Me Harder") and Positions ("off the table").
The Weeknd has shared several After Hours remixes so far, including "Blinding Lights" with Rosalía, "In Your Eyes" with Doja Cat, and more. Last month, the Weeknd re-released his debut mixtape, House of Balloons, to mark its 10th anniversary. He also recently announced he will be boycotting the Grammys going forward, refusing to attend or put his work forward for consideration, after After Hours received zero nominations at this year's ceremony.
Ariana Grande released her most recent album, Positions, last year. She also made a guest appearance on Demi Lovato's most recent album.
This article was originally published by Pitchfork.com. Read the original article here.
Rauw Alejandro and Daddy Yankee Share New Song "Panties y Brasieres": Listen
Disney Slates In-Person Upfront Event In May At NYC's Javits Center, With Jimmy Kimmel Returning For Live Set
How to Watch the 2023 Oscar Nominations Announcement

redpajama_set_name: RedPajamaCommonCrawl


Restaurant pr london is just one of the many collections of images or photos on this website. There are approximately 809 images that exist in our database associated with this post. This post of "restaurant pr london" was uploaded by dustin on 02-09-2018 and posted on the dedishop.co website with category Restaurant Interior Design and has been viewed some 25,543 times.
This pictures of "restaurant pr london" is from the above 1661x1000 resolutions which is part of the Restaurant Interior Design directory, Download this wallpapers for free in HD resolution the choice "download button" below. If you do not find the exact resolution you are looking for, then go for a native or higher resolution.
We hope you can find what you need here. We always effort to show a picture with HD resolution or at least with perfect images. Restaurant pr london can be beneficial inspiration for those who seek an image according specific categories, you can find it in this site. Finally all pictures we have been displayed in this site will inspire you all. Thank you for visiting.
This is a image related to restaurant pr london, there are approximately 809 photo related to this restaurant interior design photos gallery. Please see the details below and click on the title for more information..
Restaurant pr london is pic about Restaurant Interior Design was uploaded by lewis on 02 September 2018.
Pasternak restaurant in kiev is pic about Restaurant Interior Design was uploaded by ronnie on 16 September 2018.
Restaurant interior design ideas is background about Restaurant Interior Design was uploaded by ron on 07 September 2018.
Hospitality bar restaurant interior design agency london is wallpaper about Restaurant Interior Design was uploaded by glenn on 18 September 2018.
10 examples of stunning restaurant interior design in london is images about Restaurant Interior Design was uploaded by maurice on 01 September 2018.
10 examples of stunning restaurant interior design in london is images about Restaurant Interior Design was uploaded by bernard on 15 August 2018.
Hospitality bar restaurant interior design agency london is wallpaper about Restaurant Interior Design was uploaded by henry on 04 September 2018.
10 examples of stunning restaurant interior design in london is background about Restaurant Interior Design was uploaded by harry on 14 August 2018.
10 examples of stunning restaurant interior design in london is photo about Restaurant Interior Design was uploaded by francisco on 06 October 2018.


text:
Q: Which clustering method and number of clusters? during a cluster analysis procedure, how would I approach finding an appropriate number of clusters within my data? I've been experimenting with kmeans a little doing the following:

*

*run kmeans (with m clusters) on my feature set n times, n times because I wanted to try to overcome the limitations of random outcomes given the nature of the algorithm

*pick the "majority vote" out of the n "cluster votes" in order to choose the appropriate cluster membership

*iterate, i.e. repeat the procedure over a range of assumed amount of clusters within the data

What are alternatives to the approach sketched above?
Another issue is the fact, that I have "ordered, categorical" (ordinal) data in my dataset. I know that this might be a problem with kmeans. What are my alternatives algorithm-wise?
Thanks in advance,
Andi

A:
during a cluster analysis procedure, how would I approach finding an appropriate number of clusters within my data?
What are alternatives to the approach sketched above?

Different clustering techniques can follow different rules. k-means procedures often seek to minimize the within-sums of squares. Here is an example in R:
http://www.statmethods.net/advstats/cluster.html
These techniques do not follow a probability model, and are often based on a "best guess" approach. Model-based clustering approaches exist, one of the most known approaches uses a Gaussian-mixed model approach. The Mclust library in R uses this approach; here is a reference:
https://cran.r-project.org/web/packages/mclust/vignettes/mclust.html
In comparison to k-means, mclust allows for model comparisons via a Bayesian Information Criterion (BIC). For a summary on how mclust uses BIC for model selection, see the thread Mclust model selection

Another issue is the fact, that I have "ordered, categorical" (ordinal) data in my dataset. I know that this might be a problem with kmeans. What are my alternatives algorithm-wise?

Cluster Analysis, 5th edition, Everitt et al. on Table 9.1 discusses various clustering approaches for various data types. For mixed data types, model-based approaches are a suggested option. So mclust would be a good tool to use in your situation.
Best of luck!

redpajama_set_name: RedPajamaStackExchange


When bars, cafes and other businesses try to entice you with generic sidewalk signs, you walk right past them. But when the signs make you laugh, that business wins your loyalty for life.
Clever chalkboard signs are a warm-weather favorite for any passersby, so we've rounded up 25 of our favorites.


So if you don't like to live dangerously and would rather play it safe… call 3N1 Services your favorite carpet and furniture cleaning company at 954-821-7880. We know exactly what to do and we have the tools and cleaning solutions to do it right!
So while you may do this, remove your cushion covers for laundering, keep these points in mind and be very careful with your valuable furnishings! Do your furniture and all upholstery fabric a huge favor: Call 3N1 Services at 954-821-7880 your cleaning professionals today! Our coverage areas are from South Palm Beach to Miramar,FL.


text:
The Abstract > Innovators' Moonshots Should Guide New Food Security Policies
Innovators' Moonshots Should Guide New Food Security Policies
By Joshua Schoop, Jay Sullivan and Maeve Skelly • December 5, 2022
One of the most urgent challenges discussed the past few weeks at COP27 was climate adaptation—how to secure and empower communities worldwide that are already in the throes of climate change's worst impacts. U.S. policymakers have rightly recognized climate adaptation and food security as growing intertwined national security and development aid priorities.
Yet most acute climate adaptation challenges like climate-driven food security lack creative, well-resourced policy responses. Exacerbated by pandemic-driven supply shocks and price volatility from Russia's invasion of Ukraine, climate-driven food security challenges may only worsen as weather patterns and natural disasters become more extreme and frequent. The U.S. government and the global development community have a critical opportunity to craft policy solutions for these intertwined challenges that generate innovations while supporting scaling what already works, an entirely new way of thinking about global development.
As policymakers seek new policy solutions, entrepreneurs and NGO leaders already doing effective and outcomes-driven work around the world are the best place to look for ideas.
Earlier this year, the Federation of American Scientists partnered with Unlock Aid, working side by side with innovators to host the Global Development Moonshot Accelerator, a policy workshop to reimagine the future of global development. This workshop was an initial opportunity to expose global development experts to the idea that policy, like seed funding or infrastructure investment, is an input that supports scaling.
Innovators don't see policy as a pathway to scale
An underlying theme of this workshop was the importance of policy as a growth enabler. Innovators may not recognize policy as a viable, flexible, and rapid enough pathway to scale the solutions that have been proven effective. Good policy is needed to build a flourishing global development environment—a rising tide that lifts all entrepreneurial ships.
Policymakers have not provided adequate growth pathways in development
Solutions and evidence of what works exist but they do not always make it into policy. Policymakers have not created consistent, streamlined pathways to accelerate innovation—often limiting start-ups by shunning proven government procurement and scaling models that were built into domestic infrastructure and climate mitigation legislation.
Collaboration between innovators and policymakers must be intentional and collaborative
Most innovators are understandably hyper-focused on scaling up their individual ideas or products. The field of global development can be individualized and competitive—grants are few and far between, which doesn't always foster shared best practices. Entrepreneurs and nonprofit leaders in the field engage with communities experiencing climate change or food insecurity directly, yet they often do not have incentives or mechanisms to engage directly with policymakers. Meeting these challenges and achieving the SDGs by 2030 must be a more collaborative effort.
Moonshots offer opportunities for innovators to contribute big policy ideas
This is where policy moonshots can surface big ideas, reimagine how policy can catalyze real change, and play a meaningful connective role from those innovators most able to diagnose current barriers to scale to policymakers. Through the workshop, innovators and the Day One Project developed three promising, ready-made food security policy moonshots that provide actionable plans and model new ways of development.
Each moonshot proposes innovative ways that the U.S. government, multilateral organizations, and philanthropy should create new markets, innovations, and an ecosystem for scaling development solutions. They build off previous successful models of government-led innovation programs—some in development, others from analogous challenges.
Policymakers can find inspiration from these creative approaches. But they can also find models for how to better align their activities with the needs and ideas of the development community that works to deliver positive outcomes from foreign assistance. If we want to meet the challenges climate adaptation and food security present with policy solutions, we must include everyone and their ideas at the table.
Unlocking the U.S. Bioeconomy with the Plant Genome Project (Mary Fernandes, Solis Agrosciences)
The Plant Genome Project (PGP) would be a Human Genome Project-style, whole-of-government initiative to unlock a new era of plant science and innovation. PGP will build a comprehensive, open-access dataset of genetic and biological information on all plant species, starting with the 7,000 species that have historically been cultivated for food. By convening key stakeholders and technical talent in a novel coalition of partnerships across public and private sectors, PGP can spur growth in the bioeconomy and food security innovation.
Investing in Digital Agriculture Innovation to Secure Food, Yields, and Livelihoods (Jonathan Lehe, Gautam Bastian, & Nick Milne, Precision Development)
To spearhead USAID's leadership in digital agriculture and create a global pipeline from tested innovation to scaled impact, USAID and its U.S. government partners should launch a Digital Agriculture for Food Security Challenge, a long-term innovation pipeline for digital-enabled agriculture solutions. With an international call to action, USAID can galvanize R&D and investment for the next generation of digitally enabled technologies and solutions to secure yields and livelihoods for one hundred million smallholder farmers by 2030.
Saving 3.1 Million Lives a Year with a President's Emergency Plan to Combat Acute Childhood Malnutrition (Justin Graham, Olivia Shoemaker, & Dr. Abubakar Umar, The Taimaka Project)
Like PEPFAR galvanized the global fight against HIV/AIDS, the President's Emergency Plan for Acute Childhood Malnutrition (PEPFAM) would elevate the problem of acute childhood malnutrition, leverage new and existing food security and health programs to serve U.S. national security and humanitarian interests, and save up to 3.1 million lives around the world every year. PEPFAM would serve as a catalytic initiative to coordinate the fight against malnutrition and direct currently fragmented resources toward greater impact, cost savings, and innovation.
Categories: Public Health
← Building Momentum for Equity in Medical Devices → Cluster Development is the New Economic Development


Posterior Attention Models for Sequence to Sequence Learning Shiv Shankar, Sunita Sarawagi In ICLR, 2019.
Shiv Shankar, Siddhant Garg, Sunita Sarawagi. Surprisingly Easy Hard-Attention for Sequence to Sequence Learning. In EMNLP (short paper), 2018.
Aviral Kumar, Sunita Sarawagi, Ujjwal Jain. Trainable Calibration Measures for Neural Networks from Kernel Mean Embeddings. In ICML, 2018.
Shiv Shankar, Vihari Piratla, Soumen Chakrabarti, Siddhartha Chaudhuri, Preethi Jyothi, Sunita Sarawagi. Generalizing Across Domains via Cross-Gradient Training In ICLR, 2018.
Shiv Shankar and Sunita Sarawagi. Labeled Memory Networks for Online Model Adaptation. In AAAI, 2018.
Augmenting a neural network with memory that can grow without growing the number of trained parameters is a recent powerful concept with many exciting applications. In this paper, we establish their potential \ in online adapting a batch trained neural network to domain-relevant labeled data at deployment time. We present the design of Labeled Memory Network (LMN), a new memory augmented neural network (MANN) for fast online model adaptation. We highlight three key features of LMNs. First, LMNs treat memory as a second boosted stage following the trained network thereby allowing the memory and network to play complementary roles. Unlike all existing MANNs that write to memory at every cyc\ le, LMNs provide better memory utilization by writing only labeled data with non-zero loss. Second, LMNs organize the memory with the discrete class label as the primary key unlike existing MANNs where key is a real vector derived from the input. This simple, yet surprisingly unexplored alternative or\ ganization, safeguards against catastrophic forgetting of rare labels that current LRU based MANNs are subject to. Finally, LMNs model the evolving expertise of memory and network using a RNN, to determine onl\ ine their respective weights We evaluate online model adaptation strategies on five sequence prediction tasks, an image classification task, and two language modeling tasks. We show that LMNs are better than other MANNs designed for meta-l\ earning. We also found them to be more accurate and faster than state-of-the-art methods of retuning model parameters for adapting to domain-specific labeled data.
Pavel Sountsov and Sunita Sarawagi. Length bias in encoder decoder models and a case for global conditioning. In EMNLP, 2016.
Encoder-decoder networks are popular for modeling sequences probabilistically in many applications. These models use the power of the Long Short-Term Memory (LSTM) architecture to capture the full dependence among variables, unlike earlier models like CRFs that typically assumed conditional independence among non-adjacent variables. However in practice encoder-decoder models exhibit a bias towards short sequences that surprisingly gets worse with increasing beam size. In this paper we show that such phenomenon is due to a discrepancy between the full sequence margin and the per-element margin enforced by the locally conditioned training objective of a encoder-decoder model. The discrepancy more adversely impacts long sequences, explaining the bias towards predicting short sequences. For the case where the predicted sequences come from a closed set, we show that a globally conditioned model alleviates the above problems of encoder-decoder models. From a practical point of view, our proposed model also eliminates the need for a beam-search during inference, which reduces to an efficient dot-product based search in a vector-space.
Arun Iyer, Saketh Nath, and Sunita Sarawagi. Privacy-preserving class ratio estimation. In ACM SIGKDD, 2016.
In this paper we present learning models for the class ratio estimation problem, which takes as input an unlabeled set of instances and predicts the proportions of instances in the set belonging to the different classes. This problem has applications in social and commercial data analysis. Existing models for class-ratio estimation however require instance-level supervision. Whereas in domains like politics, and demography, set-level supervision is more common. We present a new method for directly estimating class-ratios using set-level supervision. Another serious limitation in applying these techniques to sensitive domains like health is data privacy. We propose a novel label privacy-preserving mechanism that is well-suited for supervised class ratio estimation and has guarantees for achieving efficient differential privacy, provided the per-class counts are large enough. We derive learning bounds for the estimation with and with-out privacy constraints, which lead to important insights for the data-publisher. Extensive empirical evaluation shows that our model is more accurate than existing methods and that the proposed privacy mechanism and learning model are well-suited for each other.
Alon Y. Halevy, Natalya Fridman Noy, Sunita Sarawagi, Steven Euijong Whang, and Xiao Yu. Discovering structure in the universe of attribute names. In WWW, 2016.
Recently, search engines have invested significant effort to answering entity-attribute queries from structured data, but have focused mostly on queries for frequently occurring attributes. In parallel, several research efforts have demonstrated that there is a long tail of attributes, often thousands per class of entities, that are of interest to users. Researchers are beginning to leverage these new collections of attributes to expand the ontologies that power search engines and to recognize entity-attribute queries. Because of the sheer number of potential attributes, such tasks require us to impose some structure on this long and heavy tail of attributes. This paper introduces the problem of organizing the attributes by expressing the compositional structure of their names as a rule-based grammar. These rules offer a compact and rich semantic interpretation of multi-word attributes, while generalizing from the observed attributes to new unseen ones. The paper describes an unsupervised learning method to generate such a grammar automatically from a large set of attribute names. Experiments show that our method can discover a precise grammar over 100,000 attributes of Countries while providing a 40-fold compaction over the attribute names. Furthermore, our grammar enables us to increase the precision of attributes from 47% to more than 90% with only a minimal curation effort. Thus, our approach provides an efficient and scalable way to expand ontologies with attributes of user interest.
Aman Madaan, Ashish Mittal, Mausam, Ganesh Ramakrishnan, and Sunita Sarawagi. Numerical relation extraction with minimal supervision. In AAAI Conference on Artificial Intelligence, 2016.
We study a novel task of numerical relation extraction with the goal of extracting relations where one of the arguments is a number or a quantity ( e.g., atomic_number(Aluminium, 13), inflation_rate(India, 10.9%)). This task presents peculiar challenges not found in standard IE, such as the difficulty of matching numbers in distant supervision and the importance of units. We design two extraction systems that require minimal human supervision per relation: (1) NumberRule, a rule based extractor, and (2) NumberTron, a probabilistic graphical model. We find that both systems dramatically outperform MultiR, a state-of-the-art non-numerical IE model, obtaining up to 25 points F-score improvement.
Immanuel Trummer, Alon Y. Halevy, Hongrae Lee, Sunita Sarawagi, and Rahul Gupta. Mining subjective properties on the web. In ACM SIGMOD, 2015.
Even with the recent developments in Web search of answering queries from structured data, search engines are still limited to queries with an objective answer, such as EUROPEAN CAPITALS or WOODY ALLEN MOVIES. However, many queries are subjective, such as SAFE CITIES, or CUTE ANIMALS. The underlying knowledge bases of search engines do not contain answers to these queries because they do not have a ground truth. We describe the Surveyor system that mines the dominant opinion held by authors of Web content about whether a subjective property applies to a given entity. The evidence on which SURVEYOR relies is statements extracted from Web text that either support the property or claim its negation. The key challenge that SURVEYOR faces is that simply counting the number of positive and negative statements does not suffice, because there are multiple hidden biases with which content tends to be authored on the Web. SURVEYOR employs a probabilistic model of how content is authored on the Web. As one example, this model accounts for correlations between the subjective property and the frequency with which it is mentioned on the Web. The parameters of the model are specialized to each property and entity type. Surveyor was able to process a large Web snapshot within a few hours, resulting in opinions for over 4 billion entity-property combinations. We selected a subset of 500 entity-property combinations and compared our results to the dominant opinion of a large number of Amazon Mechanical Turk (AMT) workers. The predictions of Surveyor match the results from AMT in 77% of all cases (and 87% for test cases where inter-worker agreement is high), significantly outperforming competing approaches.
Sunita Sarawagi and Soumen Chakrabarti. Open-domain quantity queries on web tables: Annotation, response, and consensus models. In ACM SIGKDD, 2014.
Over 40% of columns in hundreds of millions of Web tables contain numeric quantities. Tables are a richer source of structured knowledge than free text. We harness Web tables to answer queries whose target is a quantity with natural variation, such as net worth of zuckerburg, battery life of ipad, half life of plutonium, and calories in pizza. Our goal is to respond to such queries with a ranked list of quantity distributions, suitably represented. Apart from the challenges of informal schema and noisy extractions, which have been known since tables were used for non-quantity information extraction, we face additional problems of noisy number formats, as well as unit specifications that are often contextual and ambiguous.
Early hardening of extraction decisions at a table level leads to poor accuracy. Instead, we use a probabilistic context free grammar (PCFG) based unit extractor on the tables, and retain several top-scoring extractions of quantity and numerals. Then we inject these into a new collective inference framework that makes global decisions about the relevance of candidate table snippets, the interpretation of the query's target quantity type, the value distributions to be ranked and presented, and the degree of consensus that can be built to support the proposed quantity distributions. Experiments with over 25 million Web tables and 350 diverse queries show robust, large benefits from our quantity catalog, unit extractor, and collective inference.
Arun Iyer, Saketh Nath, and Sunita Sarawagi. Maximum mean discrepancy for class ratio estimation: Convergence bounds and kernel selection. In ICML, 2014.
In recent times, many real world applications have emerged that require estimates of class ratios in an unlabeled instance collection as opposed to labels of individual instances in the collection. In this paper we investigate the use of maximum mean discrepancy (MMD) in a reproducing kernel Hilbert space (RKHS) for estimating such ratios. First, we theoretically analyze the MMD-based estimates. Our analysis establishes that, under some mild conditions, the estimate is statistically consistent. More importantly, it provides an upper bound on the error in the estimate in terms of intuitive geometric quantities like class separation and data spread. Next, we use the insights obtained from the theoretical analysis, to propose a novel convex formulation that automatically learns the kernel to be employed in the MMD-based estimation. We design an efficient cutting plane algorithm for solving this formulation. Finally, we empirically compare our estimator with several existing methods, and show significantly improved performance under varying datasets, class ratios, and training sizes.
Gaurish Chaudhari, Vashist Avadhanula, and Sunita Sarawagi. A few good predictions: Selective node labeling in a social network. In WSDM, 2014.
Many social network applications face the following problem: given a network G=(V,E) with labels on a small subset V of nodes and an optional set of features on nodes and edges, predict the labels of the remaining nodes. Much research has gone into designing learning models and inference algorithms for accurate predictions in this setting. However, a core hurdle to any prediction effort is that for many nodes there is insufficient evidence for inferring a label.
We propose that instead of focusing on the impossible task of providing high accuracy over all nodes, we should focus on selectively making the few node predictions which will be correct with high probability. Any selective prediction strategy will require that the scores attached to node predictions be well-calibrated. Our evaluations show that existing prediction algorithms are poorly calibrated. We propose a new method of training a graphical model using a conditional likelihood objective that provides better calibration than the existing joint likelihood objective. We augment it with a decoupled confidence model created using a novel unbiased training process. Empirical evaluation on two large social networks show that we are able to select a large number of predictions with accuracy as high as 95%, even when the best overall accuracy is only 40%.
Namit Katariya, Arun Iyer, and Sunita Sarawagi. Active evaluation of classifiers on large datasets. In ICDM (Runners-up for Best paper award), 2012.
The goal of this work is to estimate the accuracy of a classifier on a large unlabeled dataset based on a small labeled set and a human labeler. We seek to estimate accuracy and select instances for labeling in a loop via a continuously refined stratified sampling strategy on the data. We present a novel algorithm for learning r bit hash functions to stratify data so as to bring together instances with similar accuracy values. We show that our algorithm of learning hash functions provides much better accuracy estimates than most existing algorithms. A major challenge that we address in this paper is how to perform stratified sampling on unlabeled data that is so large that in an interactive setting we cannot afford to make one sequential scan to find the instances in each stratum. We present an optimal algorithm for performing importance sampling on a static index over the data. Experiments on a varied set of real-life dataset of up to 50 million instances show that we are able to perform close to optimal stratified sampling by reading three orders of magnitude less data.
Rakesh Pimplikar and Sunita Sarawagi. Answering table queries on the web using column keywords. In Proc. of the 38th Int'l Conference on Very Large Databases (VLDB), 2012.
We present the design of a structured search engine which returns a multi-column table in response to a query consisting of keywords describing each of its columns. We answer such queries by exploiting the millions of tables on the Web because these are much richer sources of structured knowledge than free-format text. However, a corpus of tables harvested from arbitrary HTML webpages presents huge challenges of diversity and redundancy not seen in centrally edited knowledge bases. We concentrate on one concrete task in this paper. Given a set of Web tables T1,...,Tn, and a query Q with q sets of keywords Q1,...,Qq, decide for each Ti if it is relevant to Q and if so, identify the mapping between the columns of Ti and query columns. We represent this task as a graphical model that jointly maps all tables by incorporating diverse sources of clues spanning matches in different parts of the table, corpus-wide co-occurrence statistics, and content overlap across table columns. We define a novel query segmentation model for matching keywords to table columns, and a robust mechanism of exploiting content overlap across table columns. We design efficient inference algorithms based on bipartite matching and constrained graph cuts to solve the joint labeling task. Experiments on a workload of 59 queries over a 25 million web table corpus shows significant boost in accuracy over baseline IR methods.
Rahul Gupta and Sunita Sarawagi. Joint training for open-domain extraction on the web: Exploiting overlap when supervision is limited. In WSDM, 2011.
We consider the problem of jointly training structured mod- els for extraction from multiple web sources whose records enjoy partial content overlap. This has important applica- tions in open-domain extraction, e.g. a user materializing a table of interest from multiple relevant unstructured sources; or a site like Freebase augmenting an incomplete relation by extracting more rows from web sources. Such applications require extraction over arbitrary domains, so one cannot use a pre-trained extractor or demand a huge labeled dataset. We propose to overcome this lack of supervision by using content overlap across the related web sources. Existing methods of exploiting overlap have been developed under settings that do not generalize easily to the scale and diver- sity of overlap seen on Web sources. We present an agreement-based learning framework that jointly trains the models by biasing them to agree on the agreement regions, i.e. shared text segments. We present alternatives within our framework to trade-off tractability, robustness to noise, and extent of agreement enforced; and propose a scheme of partitioning agreement regions that leads to efficient training while maximizing overall accuracy. Further, we present a principled scheme to discover low-noise agreement regions in unlabeled data across multiple sources. Through extensive experiments over 58 different extrac- tion domains, we establish that our framework provides sig- nificant boosts over uncoupled training, and scores over al- ternatives such as collective inference, staged training, and multi-view learning.
Rahul Gupta, Sunita Sarawagi, and Ajit A. Diwan. Collective inference for extraction mrfs coupled with symmetric clique potentials. JMLR, 11, November 2010.
Sashank J. Reddi, Sunita Sarawagi, and Sundar Vishwanathan. MAP estimation in binary MRFs via bipartite multi-cuts. In NIPS (Oral presentation, Honorary mention for Outstanding student paper award), 2010.
We propose a new LP relaxation for obtaining the MAP assignment of a binary MRF with pairwise potentials. Our relaxation is derived from reducing the MAP assignment problem to an instance of a recently proposed Bipartite Multi-cut problem where the LP relaxation is guaranteed to provide an O(log k) approximation where k is the number of vertices adjacent to non-submodular edges in the MRF. We then propose a combinatorial algorithm to efficiently solve the LP and also provide a lower bound by concurrently solving its dual to within an epsilon approximation. The algorithm is up to an order of magnitude faster and provides better MAP scores and bounds than the state of the art message passing algorithm of Sontag et al 2008 that tightens the local marginal polytope with third-order marginal constraints.
Girija Limaye, Sunita Sarawagi, and Soumen Chakrabarti. Annotating and searching web tables using entities, types and relationships. In VLDB, 2010.
Tables are a universal idiom to express relational data, even for human consumption. Billions of tables on Web pages express entity references, attributes and relationships. This representation of relational world knowledge is usually considerably better than completely unstructured free-format text. At the same time, unlike manually-created knowledge bases, relational information mined from ``organic'' Web tables need not be constrained by availability of precious editorial time. Unfortunately, in the absence of any formal, uniform schema imposed on Web tables, Web search cannot take advantage of these high-quality sources of relational information. In this paper we propose new machine learning techniques to annotate table cells with entities that they likely mention, table columns with types from which entities are drawn for cells in the column, and relations that pairs of table columns are seeking to express. We propose a new graphical model for making all these labeling decisions for each table simultaneously, rather than make separate local decisions for entities, types and relations. Experiments using the YAGO catalog, DBPedia, tables from Wikipedia, and over 25 million HTML tables from a 500 million page Web crawl uniformly show the superiority of our approach. We also evaluate the impact of better annotations on a prototype relational Web search tool. We demonstrate clear benefits of our annotations beyond indexing tables in a purely textual manner.
Soumen Chakrabarti, Sunita Sarawagi, and S. Sudarshan. Enhancing search with structure. IEEE Data Eng. Bull., 33(1):3-24, 2010.
Keyword search has traditionally focussed on retrieving documents in ranked order, given simple key- word queries. Similarly, work on keyword queries on structured data has focussed on retrieving closely connected pieces of data that together contain given query keywords. In recent years, there has been a good deal of work that attempts to go beyond the above paradigms, to improve search experience on unstructured textual data as well as on structured or semi-structured data. In this paper, we survey recent work on adding structure to keyword search, which can be categorized on three axes: (a) adding structure to unstructured data, (b) adding structure to answers, and (c) adding structure to queries al- lowing more power than simple keyword queries, but while avoiding the complexity of elaborate query languages that demand extensive schema knowledge.
Rahul Gupta and Sunita Sarawagi. Answering table augmentation queries from unstructured lists on the web. In PVLDB, 2009.
We present the design of a system for assembling a table from a few example rows by harnessing the huge corpus of information-rich but unstructured lists on the web. We developed a totally unsupervised end to end approach which given the sample query rows - (a) retrieves HTML lists relevant to the query from a pre-indexed crawl of web lists, (b) segments the list records and maps the segments to the query schema using a statistical model, (c) consolidates the results from multiple lists into a unified merged table, (d) and presents to the user the consolidated records ranked by their estimated membership in the target relation.
The key challenges in this task include construction of new rows from very few examples, and an abundance of noisy and irrelevant lists that swamp the consolidation and ranking of rows. We propose modifications to statistical record segmentation models, and present novel consolidation and ranking techniques that can process input tables of arbitrary schema without requiring any human supervision. Experiments with Wikipedia target tables and 16 million unstructured lists show that even with just three sample rows, our system is very effective at recreating Wikipedia tables, with a mean runtime of around 20s.
Sunita Sarawagi, Vinay S Deshpande, and Sourabh Kasliwal. Efficient top-k count queries over imprecise duplicates. In EDBT, 2009.
We propose efficient techniques for processing various Top-K count queries on data with duplicates. Our method differs from existing work on duplicate elimination in two significant ways: First, we dedup on the fly only the part of the data actually needed for the answer - a requirement in massive and rapidly evolving sources where batch deduplication is not feasible. Given the non-local nature of the problem of partitioning data into duplicate groups, it is challenging to perform early filtering of tuples relevant to the K largest groups. We propose a novel method of successively collapsing and pruning records which yield an order of magnitude reduction in running time compared to deduplicating the entire data first.
Second, we return multiple high scoring answers to handle situations where it is impossible to resolve if two records are indeed duplicates of each other. Since finding even the highest scoring deduplication is NP-hard, the existing approach is to deploy one of many variants of score-based clustering algorithms which do not easily generalize to return multiple groupings. We model deduplication as a segmentation of a linear embedding of records and present a polynomial time algorithm to find the R highest scoring answers. This method closely matches the accuracy of an exact exponential time algorithm on several datasets.
Rahul Gupta, Sunita Sarawagi, and Ajit A. Diwan. Generalized collective inference with symmetric clique potentials, 2009.
Rahul Gupta and Sunita Sarawagi. Domain adaptation of information extraction models. In Sigmod Record, 2008.
Domain adaptation refers to the process of adapting an extraction model trained in one domain to another related domain with only unlabeled data. We present a brief survey of existing methods of retraining models to best exploit labeled data from a related domain. These approaches that involve expensive model retraining are not practical when a large number of new domains have to be handled in an operational setting. We describe our approach for adapting record extraction models that exploits the regularity within a domain to jointly label records without retraining any model.
Sunita Sarawagi. Information extraction. FnT Databases, 1(3), 2008.
Sunita Sarawagi and Rahul Gupta. Accurate max-margin training for structured output spaces. In Proceedings of the 25th International Conference on Machine Learning (ICML), USA, 2008.
Tsochantaridis et al 2005 proposed two formulations for maximum margin training of structured spaces: margin scaling and slack scaling. While margin scaling has been extensively used since it requires the same kind of MAP inference as normal structured prediction, slack scaling is believed to be more accurate and better-behaved. We present an efficient variational approximation to the slack scaling method that solves its inference bottleneck while retaining its accuracy advantage over margin scaling.
We further argue that existing scaling approaches do not separate the true labeling comprehensively while generating violating constraints. We propose a new max-margin trainer PosLearn that generates violators to ensure separation at each position of a decomposable loss function.
Empirical results on real datasets illustrate that PosLearn can reduce test error by up to 25scaling. Further, PosLearn violators can be generated more efficiently than slack violators; for many structured tasks the time required is just twice that of MAP inference.
Sandeep Satpal and Sunita Sarawagi. Domain adaptation of conditional probability models via feature subsetting. In ECML/PKDD, 2007.
The goal in domain adaptation is to train a model using labeled data sampled from a domain different from the target domain on which the model will be deployed. We exploit unlabeled data from the target domain to train a model that maximizes likelihood over the training sample while minimizing the distance between the training and target distribution. Our focus is conditional probability models used for predicting a label structure y given input x based on features defined jointly over x and y. We propose practical measures of divergence between the two domains based on which we penalize features with large divergence, while improving the effectiveness of other less deviant correlated features. Empirical evaluation on several real-life information extraction tasks using Conditional Random Fields (CRFs) show that our method of domain adaptation leads to significant reduction in error.
Rahul Gupta, Ajit A. Diwan, and Sunita Sarawagi. Efficient inference with cardinality-based clique potentials. In Proceedings of the 24th International Conference on Machine Learning (ICML), USA, 2007.
Many collective labeling tasks require inference on graphical models where the clique potentials depend only on the number of nodes that get a particular label. We design efficient inference algorithms for various families of such potentials. Our algorithms are exact for arbitrary cardinality-based clique potentials on binary labels and for max-like and majority-like clique potentials on multiple labels. Moving towards more complex potentials, we show that inference becomes NP-hard even on cliques with homogeneous Potts potentials. We present a (13)/(15)-approximation algorithm with runtime sub-quadratic in the clique size. In contrast, the best known previous guarantee for graphs with Potts potentials is only 0.5. We perform empirical comparisons on real and synthetic data, and show that our proposed methods are an order of magnitude faster than the well-known Tree-based re-parameterization (TRW) and graph-cut algorithms.
Nick Koudas, Sunita Sarawagi, and Divesh Srivastava. Record linkage: Similarity measures and algorithms. Tutorial at SIGMOD, 2006.
Rahul Gupta and Sunita Sarawagi. Curating probabilistic databases from information extraction models. In VLDB, 2006.
Many real-life applications depend on databases automatically curated from unstructured sources through imperfect structure extraction tools. Such databases are best treated as imprecise representations of multiple extraction possibilities. State-of-the-art statistical models of extraction provide a sound probability distribution over extractions but are not easy to represent and query in a relational framework. In this paper we address the challenge of approximating such distributions as imprecise data models. In particular, we investigate a model that captures both row-level and column-level uncertainty and show that this representation provides significantly better approximation compared to models that use only row or only column level uncertainty. We present efficient algorithms for finding the best approximating parameters for such a model; our algorithm exploits the structure of the model to avoid enumerating the exponential number of extraction possibilities.
Sunita Sarawagi. Efficient inference on sequence segmentation models. In Proceedings of the 23rd International Conference on Machine Learning (ICML), Pittsburgh, PA, USA, 2006.
Sequence segmentation is a flexible and highly accurate mechanism for modeling several applications. Inference on segmentation models involves dynamic programming computations that in the worst case can be cubic in the length of a sequence. In contrast, typical sequence labeling models require linear time. We remove this limitation of segmentation models vis-a-vis sequential models by designing a succinct representation of potentials common across overlapping segments. We exploit such potentials to design efficient inference algorithms that are both analytically shown to have a lower complexity and empirically found to be comparable to sequential models for typical extraction tasks.
Rahul Gupta and Sunita Sarawagi. Map estimation in mrfs via rank aggregation. In Proc. of the ICML Workshop on Open Problems in Statistical Relational Learning (co-presented with ICML Workshop on Learning in Structured Output Spaces), 2006.
Efficient estimation of the maximum a priori (MAP) assignment in large statistical relational networks still remains an open issue in spite of the extensive research in this area. We propose a novel method of exploiting top-K MAP estimates from simpler subgraphs to find an assignment that is either MAP optimal, or has an associated bound on how far it is from the optimal. Our method extends the well-known tree reweighted max-product algorithm (TRW) and is guaranteed to always provide tighter upper bounds. Experiments on synthetic and real data show that we are able to the find the optimal in many more cases than TRW, at significantly fewer iterations and our bounds are much tighter than those provided by TRW.
Imran Mansuri and Sunita Sarawagi. A system for integrating unstructured data into relational databases. In Proc. of the 22nd IEEE Int'l Conference on Data Engineering (ICDE), 2006.
In this paper we present a system for automatically integrating unstructured text into a multi-relational database using state-of-the-art statistical models for structure extraction and matching. We show how to extend current high-performing models, Conditional Random Fields and their semi-markov counterparts, to effectively exploit a variety of recognition clues available in a database of entities, thereby significantly reducing the dependence on manually labeled training data. Our system is designed to load unstructured records into columns spread across multiple tables in the database while resolving the relationship of the extracted text with existing column values, and preserving the cardinality and link constraints of the database. We show how to combine the inference algorithms of statistical models with the database imposed constraints for optimal data integration.
Amit Chandel, P.C. Nagesh, and Sunita Sarawagi. Efficient batch top-k search for dictionary-based entity recognition. In ICDE, 2006.
We consider the problem of speeding up Entity Recognition systems that exploit existing large databases of structured entities to improve extraction accuracy. These systems require the computation of the maximum similarity scores of several overlapping segments of the input text with the entity database. We formulate a batch Top-K problem with the goal of sharing computations across overlapping segments. Our proposed algorithm performs a factor of three faster than independent top-K queries and only a factor of two slower than an unachievable lower bound on total cost. We then propose a novel modification of the popular Viterbi algorithm for recognizing entities so as to work with easily computable bounds on match scores, thereby reducing the total inference time by a factor of eight compared to state-of-the-art methods.
S. Sarawagi. Sequence data mining. In Advanced Methods for Knowledge Discovery from Complex Data. Springer Verlag, 2005.
Shantanu Godbole, Ganesh Ramakrishnan, and Sunita Sarawagi. Text classification with evolving label-sets. In ICDM, 2005.
V.G.Vinod Vydiswaran and Sunita Sarawagi. Learning to extract information from large websites using sequential models. In COMAD, 2005. (Best paper award).
Sunita Sarawagi. The crf project: a java implementation. http://crf.sourceforge.net, 2004.
S. Sarawagi. Models and indices for integrating unstructured data with a relational database. In KDID, pages 1-10, 2004.
Database systems are islands of structure in a sea of unstructured data sources. Several real-world applications now need to create bridges for smooth integration of semi-structured sources with existing structured databases for seamless querying. This integration requires extracting structured column values from the unstructured source and mapping them to known database entities. Existing methods of data integration do not effectively exploit the wealth of information available in multi-relational entities. We present statistical models for co-reference resolution and information extraction in a database setting. We then go over the performance challenges of training and applying these models efficiently over very large databases. This requires us to break open a black box statistical model and extract predicates over indexable attributes of the database. We show how to extract such predicates for several classification models, including naive Bayes classifiers and support vector machines. We extend these indexing methods for supporting similarity predicates needed during data integration.
Sunita Sarawagi and William W. Cohen. Semi-markov conditional random fields for information extraction. In NIPS, 2004.
We describe semi-Markov conditional random fields (semi-CRFs), a conditionally trained version of semi-Markov chains. Intuitively, a semi-CRF on an input sequence x outputs a ``segmentation'' of x, in which labels are assigned to segments (i.e., subsequences) of x rather than to individual elements xi of x. Importantly, features for semi-CRFs can measure properties of segments, and transitions within a segment can be non-Markovian. In spite of this additional power, exact learning and inference algorithms for semi-CRFs are polynomial-time-often only a small constant factor slower than conventional CRFs. In experiments on five named entity recognition problems, semi-CRFs generally outperform conventional CRFs.
Shantanu Godbole and Sunita Sarawagi. Discriminative methods for multi-labeled classification. In PAKDD, 2004.
Abhay Harpale, Shantanu Godbole, Sunita Sarawagi, and Soumen Chakrabarti. Document classification through interactive supervision of document and term labels. In ECML/PKDD, 2004.
William W. Cohen and Sunita Sarawagi. Exploiting dictionaries in named entity extraction: Combining semi-markov extraction processes and data integration methods. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, USA, 2004.
We consider the problem of improving named entity recognition (NER) systems by using external dictionaries-more specifically, the problem of extending state-of-the-art NER systems by incorporating information about the similarity of extracted entities to entities in an external dictionary. This is difficult because most high-performance named entity recognition systems operate by sequentially classifying words as to whether or not they participate in an entity name; however, the most useful similarity measures score entire candidate names. To correct this mismatch we formalize a semi-Markov extraction process, which is based on sequentially classifying segments of several adjacent words, rather than single words. In addition to allowing a natural way of coupling high-performance NER methods and high-performance similarity functions, this formalism also allows the direct use of other useful entity-level features, and provides a more natural formulation of the NER problem than sequential word classification. Experiments in multiple domains show that the new model can substantially improve extraction performance over previous methods for using external dictionaries in NER.
Sunita Sarawagi and Alok Kirpal. Efficient set joins on similarity predicates. In Proceedings of the ACM SIGMOD International Conference on Management of Data, 2004.
In this paper we present an efficient, scalable and general algorithm for performing set joins on predicates involving various similarity measures like intersect size, Jaccard-coefficient, cosine similarity, and edit-distance. This expands the existing suite of algorithms for set joins on simpler predicates such as, set containment, equality and non-zero overlap. We start with a basic inverted index based probing method and add a sequence of optimizations that result in one to two orders of magnitude improvement in running time. The algorithm folds in a data partitioning strategy that can work efficiently with an index compressed to fit in any available amount of main memory. The optimizations used in our algorithm generalize to several weighted and unweighted measures of partial word overlap between sets.
Surajit Chaudhuri, Vivek R. Narasayya, and Sunita Sarawagi. Extracting predicates from mining models for efficient query evaluation. ACM Trans. Database Syst., 29(3):508-544, 2004.
Sunita Sarawagi, Soumen Chakrabarti, and Shantanu Godbole. Cross training: learning probabilistic mappings between topics. In Proc. of the Nineth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining(KDD-2003), Washington D.C., USA, August 2003.
Classification is a well-established operation in text mining. Given a set of labels A and a set DA of training documents tagged with these labels, a classifier learns to assign labels to unlabeled test documents. Suppose we also had available a different set of labels B, together with a set of documents DB marked with labels from B. If A and B have some semantic overlap, can the availability of DB help us build a better classifier for A, and vice versa? We answer this question in the affirmative by proposing cross-training: a new approach to semi-supervised learning in presence of multiple label sets. We give distributional and discriminative algorithms for cross-training and show, through extensive experiments, that cross-training can discover and exploit probabilistic relations between two taxonomies for more accurate classification.
Surajit Chaudhuri, Prasanna Ganesan, and Sunita Sarawagi. Factorizing complex predicates in queries to exploit indexes. In Proc. ACM SIGMOD International Conf. on Management of Data, San Diego, USA, June 2003.
Decision-support applications generate queries with complex predicates. We show how the factorization of complex query expressions exposes significant opportunities for exploiting available indexes. We also present a novel idea of relaxing predicates in a complex condition to create possibilities for factoring. Our algorithms are designed for easy integration with existing query optimizers and support multiple optimization levels, providing different trade-offs between plan complexity and optimization time.
Sunita Sarawagi and Alok Kirpal. Scaling up the alias duplicate elimination system: A demostration. In Proc. of the 19th IEEE Int'l Conference on Data Engineering (ICDE), Bangalore, March 2003.
Duplicate elimination is an important step in integrating data from multiple sources. The challenges involved are finding a robust deduplication function that can identify when two records are duplicates and efficiently applying the function on very large lists of records. In ALIAS the task of designing a deduplication function is eased by learning the function from examples of duplicates and non-duplicates and by using active learning to spot such examples effectively . Here we investigate the issues involved in efficiently applying the learnt deduplication system on large lists of records. We demonstrate the working of the ALIAS evaluation engine and highlight the optimizations it uses to significantly cut down the number of record pairs that need to be explicitly materialized.
Sunita Sarawagi and Mark Craven. Sequence data mining. Tutorial at the ACM Intl' conf on Knowledge Discovery in Databases (SIGKDD), 2003.
PP Wangikar, AV Tendulkar, S Ramya, DN Mali, and S Sarawagi. Functional sites in protein families uncovered via an objective and automated graph theoretic approach. Journal of molecular biology, 326(3):955-978, 2003.
Alok Kirpal and Sunita Sarawagi. Optimizing the evaluation of complex similarity predicates. Submitted for publication, 2003.
Sunita Sarawagi, Anuradha Bhamidipaty, Alok Kirpal, and Chandra Mouli. Alias: An active learning led interactive deduplication system. In Proc. of the 28th Int'l Conference on Very Large Databases (VLDB) (Demonstration session), Hongkong, August 2002.
Deduplication, a key operation in integrating data from multiple sources, is a time-consuming, labor-intensive and domain-specific operation. We present our design of ALIAS that uses a novel approach to ease this task by limiting the manual effort to inputing simple, domain-specific attribute similarity functions and interactively labeling a small number of record pairs. We describe how active learning is useful in selecting informative examples of duplicates and non-duplicates that can be used to train a deduplication function. ALIAS provides mechanism for efficiently applying the function on large lists of records using a novel cluster-based execution model.
Shantanu Godbole, Sunita Sarawagi, and Soumen Chakrabarti. Scaling multi-class support vector machines using inter-class confusion. In Poster paper in the Proc. of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining(KDD-2002), Edmonton, Canada, July 2002.
Support vector machines (SVMs) excel at two-class discriminative learning problems. They often outperform generative classifiers, especially those that use inaccurate generative models, such as the naive Bayes (NB) classifier. On the other hand, generative classifiers have no trouble in handling an arbitrary number of classes efficiently, and NB classifiers train much faster than SVMs owing to their extreme simplicity. In contrast, SVMs handle multi-class problems by learning redundant yes/no (one-vs-others) classifiers for each class, further worsening the performance gap. We propose a new technique for multi-way classification which exploits the accuracy of SVMs and the speed of NB classifiers. We first use a NB classifier to quickly compute a confusion matrix, which is used to reduce the number and complexity of the two-class SVMs that are built in the second stage. During testing, we first get the prediction of a NB classifier and use that to selectively apply only a subset of the two-class SVMs. On standard benchmarks, our algorithm is 3 to 6 times faster than SVMs and yet matches or even exceeds their accuracy.
B. Anurandha, Anand Janakiraman, Sunita Sarawagi, and Jayant Haritsa. Building classifiers with unrepresentative training instances: Experiences from the kdd cup 2001 competition. In Proc. of Workshop on Data Mining Lessons Learnt held in conjunction with the International Conference on Machine Learning, Sydney, July 2002.
In this paper we discuss our experiences in participating in the KDD Cup 2001 competition. The task involved classifying organic molecules as either active or inactive in their binding to a receptor. The classification task presented three challenges: highly skewed class distribution, large number of features exceeding training set size by two orders of magnitude, and non-representative training instances. Of these, we found the third challenge the most interesting and novel. We present our process of experimenting with a number of classification methods before finally converging on an ensemble of decision trees constructed using a novel attribute partitioning method. Decision trees provided partial shield from the differences in data distribution and the ensemble provided stability by exploiting the redundancy in the large set of features. Finally, we employed semi-supervised learning to incorporate characteristics of the test set into the classification model. We were second-runner's up in the competition. We followed up the competition with further research in semi-supervised learning and obtained an accuracy higher than that of the winning entry.
Surajit Chaudhuri, Vivek Narasayya, and Sunita Sarawagi. Efficient evaluation of queries with mining predicates. In Proc. of the 18th IEEE Int'l Conference on Data Engineering (ICDE), San Jose, USA, April 2002.
Modern relational database systems are beginning to support ad hoc queries on mining models. In this paper, we explore novel techniques for optimizing queries that apply mining models to relational data. For such queries, we use the internal structure of the mining model to automatically derive traditional database predicates. We present algorithms for deriving such predicates for some popular discrete mining models: decision trees, naive Bayes, and clustering. Our experiments on Microsoft SQL Server 2000 demonstrate that these derived predicates can significantly reduce the cost of evaluating such queries.
Sunita Sarawagi and Anuradha Bhamidipaty. Interactive deduplication using active learning. In SIGKDD, 2002.
Deduplication is a key operation in integrating data from multiple sources. The main challenge in this task is designing a function that can resolve when a pair of records refer to the same entity in spite of various data inconsistencies. Most existing systems use hand-coded functions. One way to overcome the tedium of hand-coding is to train a classifier to distinguish between duplicates and non-duplicates. The success of this method critically hinges on being able to provide a covering and challenging set of training pairs that bring out the subtlety of the deduplication function. This is non-trivial because it requires manually searching for various data inconsistencies between any two records spread apart in large lists. We present our design of a learning-based deduplication system that uses a novel method of interactively discovering challenging training pairs using active learning. Our experiments on real-life datasets show that active learning significantly reduces the number of instances needed to achieve high accuracy. We investigate various design issues that arise in building a system to provide interactive response, fast convergence, and interpretable output.
Sunita Sarawagi. Automation in information extraction and data integration. Tutorial at the Intl' conf on Very Large DataBases 2002,Hongkong., 2002.
G. Sathe and S. Sarawagi. Intelligent rollups in multidimensional olap data. In Proc. of the 27th Int'l Conference on Very Large Databases (VLDB), pages 307-316, Rome,Italy, 2001.
In this paper we propose a new operator for advanced exploration of large multidimensional databases. The proposed operator can automatically generalize from a specific problem case in detailed data and return the broadest context in which the problem occurs. Such a functionality would be useful to an analyst who after observing a problem case, say a drop in sales for a product in a store, would like to find the exact scope of the problem. With existing tools he would have to manually search around the problem tuple trying to draw a pattern. This process is both tedious and imprecise. Our proposed operator can automate these manual steps and return in a single step a compact and easy-to-interpret summary of all possible maximal generalizations along various roll-up paths around the case. We present a flexible cost-based framework that can generalize various kinds of behaviour (not simply drops) while requiring little additional customization from the user. We design an algorithm that can work efficiently on large multidimensional hierarchical data cubes so as to be usable in an interactive setting.
Vinayak R. Borkar, Kaustubh Deshmukh, and Sunita Sarawagi. Automatic text segmentation for extracting structured records. In Proc. ACM SIGMOD International Conf. on Management of Data, Santa Barabara,USA, 2001.
In this paper we present a method for automatically segmenting unformatted text records into structured elements. Several useful data sources today are human-generated as continuous text whereas convenient usage requires the data to be organized as structured records. A prime motivation is the warehouse address cleaning problem of transforming dirty addresses stored in large corporate databases as a single text field into subfields like ``City'' and ``Street''. Existing tools rely on hand-tuned, domain-specific rule-based systems.
We describe a tool DATAMOLD that learns to automatically extract structure when seeded with a small number of training examples. The tool enhances on Hidden Markov Models (HMM) to build a powerful probabilistic model that corroborates multiple sources of information including, the sequence of elements, their length distribution, distinguishing words from the vocabulary and an optional external data dictionary. Experiments on real-life datasets yielded accuracy of 90% on Asian addresses and 99% on US addresses. In contrast, existing information extraction methods based on rule-learning techniques yielded considerably lower accuracy.
S. Sarawagi. User-cognizant multidimensional analysis. The VLDB Journal, 10(2-3):224-239, 2001.
Our goal is to enhance multidimensional database systems with a suite of advanced operators to automate data analysis tasks that are currently handled through manual exploration. In this paper we present a key component of our system that characterizes the information content of a cell based on a user's prior familiarity with the cube and provides a context-sensitive exploration of the cube. There are three main modules of this component. A Tracker, that continuously tracks the parts of the cube that a user has visited. A Modeler, that pieces together the information in the visited parts to model the user's expected values in the unvisited parts. An Informer, that processes user's queries about the most informative unvisited parts of the cube. The mathematical basis for the expected value modeling is provided by the classical Maximum Entropy principle. Accordingly, the expected values are computed so as to agree with every value that is already visited while reducing assumptions about unvisited values to the minimum by maximizing their entropy. The most informative values are defined as those that bring the new expected values closest to the actual values. We believe and prove through experiments that such a user-in-the-loop exploration will enable much faster assimilation of all significant information in the data compared to existing manual explorations.
S. Sarawagi. idiff: Informative summarization of differences in multidimensional aggregates. Data Mining and Knowledge Discovery journal, 4(5):255-276, 2001.
Multidimensional OLAP products provide an excellent opportunity for integrating mining functionality because of their widespread acceptance as a decision support tool and their existing heavy reliance on manual, user-driven analysis. Most OLAP products are rather simplistic and rely heavily on the user's intuition to manually drive the discovery process. Such ad hoc user-driven exploration gets tedious and error-prone as data dimensionality and size increases. Our goal is to automate these manual discovery processes. In this paper we present an example of such automation through a operator that in a single step returns summarized reasons for drops or increases observed at an aggregated level.
We formulate this as a problem of summarizing the difference between two multidimensional arrays of real numbers. We develop a general framework for such summarization and propose a specific formulation for the case of OLAP aggregates. We design an efficient dynamic programming algorithm that requires only one pass of the data and uses a small amount of memory independent of the data size. This allows easy integration with existing OLAP products. Our prototype has been tested on the Microsoft OLAP server, DB2/UDB and Oracle 8i. Experiments using the OLAP benchmark demonstrate (1) scalability of our algorithm as the size and dimensionality of the cube increases and (2) feasibility of getting interactive answers with modest hardware resources.
S. Sarawagi and G. Sathe. i3: Intelligent, Interactive Investigaton of OLAP data cubes. In Proc. ACM SIGMOD International Conf. on Management of Data (Demonstration section), Dallas USA, May 2000. http://www.cse.iitb.ac.in/~sunita/icube.
The goal of the (eye cube) project is to enhance multidimensional database products with a suite of advanced operators to automate data analysis tasks that are currently handled through manual exploration. Most OLAP products are rather simplistic and rely heavily on the user's intuition to manually drive the discovery process. Such ad hoc user-driven exploration gets tedious and error-prone as data dimensionality and size increases. We first investigated how and why analysts currently explore the data cube and then automated them using advanced operators that can be invoked interactively like existing simple operators.
S. Sarawagi and S. Nagaralu. Data mining as an intac service. Sigkdd Explorations, 2(1), 2000.
The goal of this article is to raise a debate on the usefulness of providing data mining models as services on the intac. These services can be provided by anyone with adequate data and expertise and made available on the intac for anyone to use. For instance, Yahoo or Altavista, given their huge categorized document collection, can train a document classifier and provide the model as a service on the intac. This way data mining can be made accessible to a wider audience instead of being limited to people with the data and the expertise. A host of practical problems need to be solved before this idea can be made to work. We identify them and close with an invitation for further debate and investigation.
S. Sarawagi. User-adaptive exploration of multidimensional data. In Proc. of the 26th Int'l Conference on Very Large Databases (VLDB), pages 307-316, Cairo,Egypt, 2000.
In this paper we present a tool for enhanced exploration of OLAP data that is adaptive to a user's prior knowledge of the data. The tool continuously keeps track of the parts of the cube that a user has visited. The information in these scattered visited parts of the cube is pieced together to form a model of the user's expected values in the unvisited parts. The mathematical foundation for this modeling is provided by the classical Maximum Entropy principle. At any time, the user can query for the most surprising unvisited parts of the cube. The most surprising values are defined as those which if known to the user would bring the new expected values closest to the actual values. This process of updating the user's context based on visited parts and querying for regions to explore further continues in a loop until the user's mental model perfectly matches the actual cube. We believe and prove through experiments that such a user-in-the-loop exploration will enable much faster assimilation of all significant information in the data compared to existing manual explorations.
Sunita Sarawagi, Shiby Thomas, and Rakesh Agrawal. Integrating association rule mining with databases: alternatives and implications. Data Mining and Knowledge Discovery journal, 4(2-3):89-125, 2000.
Data mining on large data warehouses is becoming increasingly important. In support of this trend, we consider a spectrum of architectural alternatives for coupling mining with database systems. These alternatives include: loose-coupling through a SQL cursor interface; encapsulation of a mining algorithm in a stored procedure; caching the data to a file system on-the-fly and mining; tight-coupling using primarily user-defined functions; and SQL implementations for processing in the DBMS. We comprehensively study the option of expressing the mining algorithm in the form of SQL queries using Association rule mining as a case in point. We consider four options in and six options in SQL enhanced with object-relational extensions (). Our evaluation of the different architectural alternatives shows that from a performance perspective, the option is superior, although the performance of the option is within a factor of two. Both the and the approaches incur a higher storage penalty than the loose-coupling approach which performance-wise is a factor of 3 to 4 worse than . The implementations were too slow to qualify as a competitive option. We also compare these alternatives on the basis of qualitative factors like automatic parallelization, development ease, portability and inter-operability.
S. Sarawagi. Explaining differences in multidimensional aggregates. In Proc. of the 25th Int'l Conference on Very Large Databases (VLDB), pages 42-53, Scotland, UK, 1999.
Our goal is to enhance multidimensional database systems with advanced mining primitives. Current Online Analytical Processing (OLAP) products provide a minimal set of basic aggregate operators like sum and average and a set of basic navigational operators like drill-downs and roll-ups. These operators have to be driven entirely by the analyst's intuition. Such ad hoc exploration gets tedious and error-prone as data dimensionality and size increases. In earlier work we presented one such advanced primitive where we pre-mined OLAP data for exceptions, summarized the exceptions at appropriate levels, and used them to lead the analyst to the interesting regions.
In this paper we present a second enhancement: a single operator that lets the analyst get summarized reasons for drops or increases observed at an aggregated level. This eliminates the need to manually drill-down for such reasons. We develop an information theoretic formulation for expressing the reasons that is compact and easy to interpret. We design a dynamic programming algorithm that requires only one pass of the data improving significantly over our initial greedy algorithm that required multiple passes. In addition, the algorithm uses a small amount of memory independent of the data size. This allows easy integration with existing OLAP products. We illustrate with our prototype on the DB2/UDB ROLAP product with the Excel Pivot-table frontend. Experiments on this prototype using the OLAP data benchmark demonstrate (1) scalability of our algorithm as the size and dimensionality of the cube increases and (2) feasibility of getting interactive answers even with modest hardware resources.
S. Chakrabarti, S. Sarawagi, and B. Dom. Mining surprising temporal patterns. In Proc. of the Twenty fourth Int'l conf. on Very Large Databases (VLDB), New York, USA, Aug 1998.
We propose a new notion of surprising temporal patterns in market basket data, and algorithms to find such patterns. This is distinct from finding frequent patterns as addressed in the common mining literature. We argue that once the analyst is already familiar with prevalent patterns in the data, the greatest incremental benefit is likely to be from changes in the relationship between item frequencies over time.
A simple measure of surprise is the extent of departure from a model, estimated using standard multivariate time series analysis. Unfortunately, such estimation involves models, smoothing windows and parameters whose optimal choices can vary dramatically from one application to another. In contrast, we propose a precise characterization of surprise based on the number of bits in which a basket sequence can be encoded under a carefully chosen coding scheme. In this scheme it is inexpensive to encode sequences of itemsets that have steady, hence likely to be well-known, correlation between items. Conversely, a sequence with large code length hints at a possibly surprising correlation.
Our notion of surprise also has the desirable property that the score of a set of items is offset by anything surprising that the user may already know from the marginal distribution of any proper subset. No parameters, such as support, confidence, or smoothing windows, need to be estimated or specified by the user.
We experimented with real-life market basket data. The algorithm successfully rejected a large number of frequent sets of items that bore obvious and steady complementary relations to each other, such as cereal and milk. Instead, our algorithm found itemsets that showed statistically strong fluctuations in correlation over time. These items had no obviously complementary roles.
Sunita Sarawagi, Shiby Thomas, and Rakesh Agrawal. Integrating association rule mining with databases: alternatives and implications. In Proc. ACM SIGMOD International Conf. on Management of Data (Best paper award), Seattle, USA, June 1998.
Data mining on large data warehouses is becoming increasingly important. In support of this trend, we consider a spectrum of architectural alternatives for coupling mining with database systems. These alternatives include: loose-coupling through a SQL cursor interface; encapsulation of a mining algorithm in a stored procedure; caching the data to a file system on-the-fly and mining; tight-coupling using primarily user-defined functions; and SQL implementations for processing in the DBMS. We comprehensively study the option of expressing the mining algorithm in the form of SQL queries using Association rule mining as a case in point. We consider four options in SQL-92 and six options in SQL enhanced with object-relational extensions (SQL-OR). Our evaluation of the different architectural alternatives shows that from a performance perspective, the Cache-Mine option is superior, although the performance of the SQL-OR option is within a factor of two. Both the Cache-Mine and the SQL-OR approaches incur a higher storage penalty than the loose-coupling approach which performance-wise is a factor of 3 to 4 worse than Cache-Mine. The SQL-92 implementations were too slow to qualify as a competitive option. We also compare these alternatives on the basis of qualitative factors like automatic parallelization, development ease, portability and inter-operability.
Sunita Sarawagi, Rakesh Agrawal, and Nimrod Megiddo. Discovery-driven exploration of OLAP data cubes. In Proc. of the 6th Int'l Conference on Extending Database Technology (EDBT), pages 168-182, Valencia, Spain, March 1998.
A dominant application of OLAP data cubes is the interactive exploration of business data by an analyst to find regions of anomaly. Analysts often have to go through multiple drill-downs and selection stages before finding anything interesting. We propose a new discovery-driven exploration paradigm that pre-mines the data for such exceptions, summarizes the exceptions at appropriate levels, and leads the analyst to the interesting regions. We discuss the statistical basis of our approach and describe computation techniques that make this methodology feasible for large data bases.
S.Thomas and S.Sarawagi. Mining generalized association rules and sequential patterns using sql queries. In Poster at the 4th International Conference on Knowledge Discovery and Data Mining (KDD-98), New York, USA, 1998.
Database integration of mining is becoming increasingly important with the installation of larger and larger data warehouses built around relational database technology. Most of the commercially available mining systems integrate loosely (typically, through an ODBC or SQL cursor interface) with data stored in DBMSs. In cases where the mining algorithm makes multiple passes over the data, it is also possible to cache the data in flat files rather than retrieve multiple times from the DBMS, to achieve better performance. Recent studies have found that for association rule mining, with carefully tuned SQL formulations it is possible to achieve performance comparable to systems that cache the data in files outside the DBMS. The SQL implementation has potential for offering other qualitative advantages like automatic parallelization, development ease, portability and inter-operability with relational operators. In this paper, we present several alternatives for formulating as SQL queries association rule generalized to handle items with hierarchies on them and sequential pattern mining. This work illustrates that it is possible to express computations that are significantly more complicated than simple boolean associations, in SQL using essentially the same framework.
Rakesh Agrawal, Ashish Gupta, and Sunita Sarawagi. Modeling multidimensional databases. In Proc. of the 13th Int'l Conference on Data Engineering (ICDE), Birmingham, U.K., April 1997.
Sunita Sarawagi. Indexing OLAP data. IEEE Data Engineering Bulletin (invited), Mar 1997.
Sunita Sarawagi. Execution reordering for tertiary memory access. IEEE Data Engineering Bulletin (invited), Sept 1997.
S. Agarwal, R. Agrawal, P.M. Deshpande, A. Gupta, J.F. Naughton, R. Ramakrishnan, and S. Sarawagi. On the computation of multidimensional aggregates. In Proc. of the 22nd Int'l Conference on Very Large Databases, pages 506-521, Mumbai (Bombay), India, September 1996.
On-Line Analytical Processing (OLAP) applications often require computation of multiple related group-bys. This paper presents fast algorithms for computing a collection of group-bys. We focus first on a special case of the aggregation problem-computation of the cube operator. The cube operator requires computing group-bys on all possible combinations of a list of attributes. Our algorithms extend hash-based and sort-based grouping methods with several optimizations, like combining common operations across multiple group-bys, caching, and using pre-computed group-bys for computing other group-bys. Empirical evaluation using real-life OLAP data shows that the resulting algorithms yield a factor of two to eight improvement over straightforward methods and have running times very close to estimated lower bounds.
We then extend our algorithms to compute a subset of a cube in which the required set of aggregates does not include all combinations of attributes. Finally, we extend our algorithms to handle the common OLAP case in which attributes are grouped along hierarchies defined on them.
S. Agarwal, R. Agrawal, P.M. Deshpande, A. Gupta, J.F. Naughton, R. Ramakrishnan, and S. Sarawagi. On the computation of multidimensional aggregates. pages 506-521, September 1996.
Sunita Sarawagi and Mike Stonebraker. Reordering execution in tertiary memory databases. In Proc. of the 22nd Int'l Conference on Very Large Databases (VLDB), Mumbai (Bombay), India, September 1996.
In the relational data model the order of fetching data does not affect the correctness of query semantics. This flexibility has been exploited in query optimization by statically reordering data accesses. However, once a query is optimized, it is processed in a fixed order in most systems, with the result that data requests are made in a fixed order. Only limited forms of runtime reordering can be provided by low-level device managers that schedule I/O requests from multiple users, or by asynchronous batch prefetch requests. More aggressive reordering strategies are essential in scenarios where the latency of access to data objects varies widely and dynamically, as in tertiary devices. This paper presents such a strategy. Our key innovation is to exploit dynamic reordering to match execution order to the optimal data fetch order, in all parts of the plan-tree. To demonstrate the practicality of our approach and the impact of our optimizations, we report on a prototype implementation based on Postgres. Using our system, typical I/O cost for queries on tertiary memory databases is as much as an order of magnitude smaller than on conventional systems.
Sunita Sarawagi, Rakesh Agrawal, and Ashish Gupta. On computing the data cube. Research Report RJ 10026, IBM Almaden Research Center, San Jose, California, 1996. Available from http://www.almaden.ibm.com/cs/quest.
Rakesh Agrawal, Ashish Gupta, and Sunita Sarawagi. Modeling multidimensional databases. Research report, IBM Almaden Research Center, San Jose, California, 1996.
Multidimensional databases have recently gained widespread acceptance in the commercial world for supporting on-line analytical processing (OLAP) applications. We propose a hypercube-based data model and a few basic algebraic operations that provide semantic foundation to multidimensional databases and extend their current functionality. The operators are composable, reorderable, and closed in application. They make possible declarative specification and optimization of multidimensional database queries that are currently specified operationally. The operators can be translated to SQL and can be implemented on top of either a relational database system or a special purpose multidimensional database engine. In effect, they provide an algebraic application programming interface (API) that allows the separation of the frontend from the backend. This formalization provides a framework in which to study multidimensional databases and opens several new research problems.
S. Sarawagi. Query processing and caching in tertiary memory databases. In Proc. of the Twenty first Int'l conf. on Very Large Databases (VLDB), Zurich, Switzerland, Sep 1995.
With rapid increase in the number of applications that require access to large amounts of data, it is becoming increasingly important for database systems to handle tertiary storage devices. The characteristics of tertiary memory devices are very different from secondary storage devices that conventional database systems are designed for. This requires new approaches to managing data location and movement, together with query execution in a unified framework. In this paper we present methods of scheduling queries, caching and controlling the order of data retrieval for efficient operation in a tertiary memory environment. We show how careful interspersing of queries and informed cache management can achieve remarkable reductions in access time compared to conventional methods. Our algorithms use a few model parameters for each tertiary memory device and are thus designed to be portable across a wide variety of tertiary memory devices and database types. We are extending the Postgres database system to implement the new query processing strategies. Initial measurements on the prototype yield impressive results.
S. Sarawagi. Database systems for efficient access to tertiary memory. In Proc. IEEE Mass Storage Symposium (MSS), Sep 1995.
S. Sarawagi and M. Stonebraker. Efficient organization of large multidimensional arrays. In Proc. tenth international Conference on Data Engineering (ICDE), Houston, Texas, 1994.
Large multidimensional arrays are widely used in scientific and engineering database applications. In this paper, we present methods of organizing arrays to make their access on secondary and tertiary memory devices fast and efficient. We have developed four techniques for doing this: (1) storing the array in multidimensional ``chunks'' to minimize the number of blocks fetched, (2) reordering the chunked array to minimize seek distance between accessed blocks, (3) maintaining redundant copies of the array, each organized for a different chunk size and ordering and (4) partitioning the array onto platters of a tertiary memory device so as to minimize the number of platter switches. Our measurements on real data obtained from global change scientists show that accesses on arrays organized using these techniques are often an order of magnitude faster than on the unoptimized data.
S. Sarawagi and M. Stonebraker. Single query optimization in tertiary memory. Technical Report Sequoia 2000, S2k-94-45, University of California at Berkeley, 1994.


Comprising a shower head, shower rail and shower hose, this GROHE New Tempesta 100 shower rail set is the one to choose if you're looking for ultimate functionality allied to design excellence. For those who like to treat themselves to an extra-long shower, your water consumption is capped at 9.5 litres per minute even at full volume thanks to the GROHE EcoJoy system. The Rain spray will indulge you with its feel of a relaxing spa, while the GROHE DreamSpray technology guarantees a consistent flow from all nozzles. Our SpeedClean anti-lime system means limecale can't build up and clog nozzles, while a wipe with a dry cloth is enough to keep the dazzling GROHE StarLight chrome finish pristine. All this makes it an ideal choice for ease of use and showering enjoyment.


text:
Christy Bruce
Christy Bruce began her career improvising at The Loose Moose Theatre in Calgary, Alberta where she studied with Keith Johnstone (author of "Impro" and "Impro for Storytellers"). In 2000, she moved to Toronto and joined the "The Second City National Tour Co". She has been performing and working with Second City for over 15 years now doing shows across the county and as far away as Bosnia and Monaco. She has also starred in Rebecca Northan's "Blind Date" for the last four years across Canada and in London's West End. Other Select Theatre: "Legend Has It" (ATP), "DINK!" (The Factory Theatre), "This is Cancer" (Halifax), "The Forum" (Stratford Festival), and "Private Lives" with Kim Cattrall and Paul Gross (New York). Select TV: The Handmaid's Tail, Reign, Newborn Moms for CBC, The Strain, Orphan Black, The Odd Squad, The Day the Old Man Knocked, Long Story Short: CBC's 75 Anniversary, and Little Mosque on the Prairie.


Beloit College documented as doodles through the years.
A surprising guest makes his way into Beloit history.
The story of Beloit College's first Chinese student.
Beloit's early newspaper/blueprint writer had an early talent.
The Beloit College archives contain a surprising amount of Presidential signatures.
The origins of the Beloit bookstore, founded by a students.
An early photo spread from Beloit promotional literature.
One of Beloit College's early buildings meets its end.
Beloit College's early publications from the 19th century.