text:
College-to-University Transfer Arrangements and Undergraduate Education: Ontario in a National and International Context
This paper examines the implications of expanding the number and scope of college-to-university transfer arrangements as a means of meeting the demand for undergraduate degrees in Ontario. It focuses on two research questions:
1.	What are the differences in the learning outcomes of students in college-to-university transfer arrangements compared with those in four-year university programs?
2.	What are the differences in the cost per student for college-to-university transfer arrangements compared with four-year university programs?
White Men's Racial Others
Background/Context: Increasingly, researchers and educators have argued that alternative conceptions of Whiteness and White racial identity are needed because current conceptions have undermined, rather than strengthened, our critical pedagogies with White people. Grounded in critical Whiteness studies, and drawing especially on the writings of Ralph Ellison and Leslie Fiedler on what it means to be a White American, this article describes and theorizes White racial identity in ways that avoid oversimplification, but that at the same time never lose sight of White privilege and a larger White supremacist context.
Focus of Study: The research focused on the social production of racial identity for four White men and explored how their racial identities were dependent on relations with real and imagined racial others.
Social Class, Poverty, and Education: Policy and Practice
A friend recently was attempting to describe for me the purpose of a committee devoted to studying public education on which he sits. In a sense, he began, all we're trying to do is "wrap our brains around these utterly complex matters." His point is well taken, especially when one reads, for example, a report such as the one my colleague David Steiner prepared for the Bertelsmann Foundation, "Educational Achievement and Reform Strategies in the United States of America," (2001) in which, after pages of truly elegant prose, he concluded that much of public education is really a mess.
Six Lenses for Anti-Oppressive Education: Partial Stories, Improbable Conversations
In the second edition of Six Lenses for Anti-Oppressive Education: Partial Stories, Improbable Conversations, editors Bic Ngo and Kevin Kumashiro bring together multiple perspectives that examine, analyze, and bring to the fore systemic oppressive social relations. They investigate racism, (hetero)sexism, white privilege, classism, and the global neoliberal economic system, as well as offer tools—or lenses—for conceptualizing anti-oppressive education.
Inside the "Invisible Sector" of Higher Education: What Do We Know About Canada's Private Career Colleges?
Career colleges and private training institutions, known in some provinces as private vocational or occupational providers, make a significant contribution to education and learning in Canada, with thousands of Canadians graduating each year from hundres of these institutions.
Prevailing Attitudes about the Role of Women in Distance Learning Administration
The increasing scarcity of women within higher academic ranks is troublesome, especially as associate and full-professors with tenure are generally those tapped for leadership positions. This study surveyed female administrators in distance education in an effort to thematically analyze their perceptions of distance learning in higher education. Themes that garnered more input from the women included the following: assumptions of gender disparity, the optimistic viewpoint that in the future more women will succeed as administrators in distance education, and the belief that the role of administrators was to provide value and goals in distance education but that change in this arena was too slow and obstructions to the quality of distance learning needed to be eliminated. In addition, it appears that Caucasian (non - Hispanic) women are more prone to suggest that gender disparity is a problem and women who hold a higher level of administration spoke less often about problems with gender disparity and appeared to have a more positive attitude.
Responsive Open Learning Environments
Personal learning environments (PLEs) hold the potential to address the needs of formal and informal learners for multi-sourced content and easily customisable learning environments. This chapter presents an overview of the European project ROLE (Responsive Open Learning Environments), which specialises in the development and evaluation of learning environments that can be personalised by individual learners according to their particular needs, thus enabling them to become self-regulated learners.
Don't Tell the Faculty: Administrators' Secrets to Evaluating Online Teaching
Administrators at many colleges and universities have had online courses at their institutions for many years, now. One of the hidden challenges about online courses is that they tend to be observed and evaluated far less frequently than their face-to-face course counterparts. This is party due to the fact that many of us administrators today never taught online courses ourselves when we were teaching. This article provides six "secrets" to performing meaningful observations and evaluations of online teaching, including how to use data analytics, avoid biases, and produce useful results even if observers have never taught online themselves.
Building on strengths, addressing weaknesses
When Ontario began to expand its higher education system in the mid-1960s, it made an important choice: to provide public funding to universities on the basis of a formula. Many jurisdictions, in Canada and beyond, do not use such formulae in their higher education systems. But there are clear advantages to such an arrangement. A funding formula supports the distribution of funding in a predictable, equitable way, that can be easily understood by those who study and work within our universities.
Nevertheless, no formula can remain functional forever, especially as the world changes and our expectations of universities shift. For this reason, OCUFA welcomes the University Funding Formula Review, initiated by the Government of Ontario in early 2015. We particularly welcome the opportunity to provide feedback into this process on behalf of the province's professors and academic librarians.
The university funding formula is deeply important to the success and vitality of Ontario's universities. It cannot therefore be treated as a laboratory to play with the latest fads in university finance. A measured and responsible approach to reforming the university funding formula should retain its greatest strengths, while correcting its flaws. The Government of Ontario, as the steward of the university sector, has the important task of working with the sector to identify these weaknesses and strengths, and rejecting harmful policy proposals masquerading as innovations.
This submission makes the case that the basic mechanic of the existing formula is sound, but needs to be updated and streamlined. It is also important to consider how the existing formula does not serve some universities – such as those in Northern Ontario – and how changes can be made to address these challenges.
We also argue that performance funding – currently a cause célèbre south of the border, chiefly among those who do not actually work in universities – is not the right approach for Ontario. There is no evidence that performance funding improves student outcomes, but there is growing evidence that it actually has a variety of negative effects. It also violates numerous principles outlined by the University Funding Formula Review team, while cutting against beneficial and collaborative processes for improving quality.
Finally, we suggest that the goals of transparency, accountability, and quality are best served by a new higher education data system. Such a system would be created and run collaboratively by the sector, with the goal of fueling meaningful policy discussions through the provision of timely and useful data.
Once again, OCUFA appreciates the opportunity to provide input into the University Funding Formula Review. We look forward to working with the government to build a university system that promotes quality while protecting the important principles that have allowed our institutions to be so successful.
Reform, or Séance? Seeking the "Spirit" of No Child Left Behind
As recent state critiques of No Child Left Behind (NCLB) make clear, the states and federal government are far apart in their understanding of how the spirit of NCLB might continue to take tangible form. This brief article lays out some of the major divides and their implications and urges that the two sides work in good faith to bridge them.
It comes as little surprise that the consensus forged around the No Child Left Behind Act (NCLB) back in 2001 has begun to unravel. The surprise was that such a consensus was achieved at the time—and doing so required, besides hard work, an appeal to ambiguity during the legislative process that could not be sustained once implementation of the law began. Once the Department of Education, states, and districts had to tangle with the tangible requirements of (among other things) setting standards, creating tests, hiring highly qualified teachers, and providing supplemental tutoring, the widely supported ideal of "accountability" was bound to give way to a series of definitional disputes.
Myths and Realities of First Nations Education
The structure of education on reserve
Unlike in our provincial education systems, there are no minimum legislated education standards for on-reserve First Nations students. Canadian taxpay-ers are funding an education system in First Nations communities that has no legislated mandate for a core curriculum meeting provincial standards, no requirement that educators in First Nations schools have provincial certifi-cation, and no requirement for First Nations schools to award a recognized provincial diploma. This has resulted in "situations where First Nation youth graduate from education institutions on reserve but cannot demonstrate a recognizable diploma to a workplace or post secondary institution" (Canada, AANDC, 2014c). This system is clearly failing First Nations children.
Mining and Aboriginal Rights in Yukon: How Certainty Affects Investor Confidence
Legal uncertainty is a topic often raised in discussing unresolved Aboriginal land claims, such as those in British Columbia. Mining and Aboriginal Rights in Yukon examines legal uncertainty on Aboriginal rights in a different way, and in an under-examined Northern context. We examine what we identify as growing legal uncer-tainty in Yukon. This topic is not one that would have been expected a few years ago. In Yukon, modern land claims agreements with 11 out of the territory's 14 First Nations once seemed to have established a high degree of certainty on Aboriginal claims. This certainty was even seen as a significant advantage for Yukon in the global competition for mining investment.
The Mindful Teacher
What is "mindful teaching"? It entails, as Elizabeth MacDonald and Dennis Shirley explain, an "openness to new information, a willingness to explore topics that are marginalized in the dominant reform fads of the moment, and a readiness to review one's previous assumptions as a part of a life-long career marked by critical inquiry, reflection and compassion" (p. 27). That definition seems reminiscent of reflective teaching. It certainly appears related.1 But there seem to be qualitative differences between reflective teaching and mindful teaching. Within the last decade a body of literature has blossomed; it is a literature that borrows from western and eastern contemplative traditions, underscores the role of the self and emotions in teaching, and attempts to consider the conflicts, conundrums, and paradoxes of teaching. Parker Palmer (1998), Irene McHenry and Richard Brady (2009), Rachael Kessler (2000), Linda Lantieri (2001), and Maria Lichtman (2005) are a few of the authors who have ventured into these dimensions of vocational exploration. It is a growing literature and one worth examining. Within this space MacDonald and Shirley, a public school teacher and an academic respectively, offer valuable insights and a description of an unusual program.
Mind-Body Tools for Teachers: A Proposal for Incorporating Mindfulness Techniques into Teacher Education
This is a proposal to teach classroom-based mindfulness techniques to teacher education candidates as part of their teacher education programs. While mindfulness, including yoga and meditation, is growing more popular in a range of educational settings, the majority of K-12 programs are delivered to schools through external personnel from yoga or mindfulness service organizations. In many cases, these programs are provided at low or no cost to schools, or individual teachers might take trainings ranging from about $600-$2500. A more sustainable, affordable and ethical scenario would be to develop the capacities of teachers to employ mindfulness techniques for their own wellbeing, and that of their students, during their teacher education programs.
Measuring Student Engagement in an Online Program
In an effort to measure the effectiveness of faculty development courses promoting student engagement, the faculty development unit of Penn State's Online Campus conducted a pilot study within a large online Bachelor of Science in Business (BSB) program. In all, 2,296 students were surveyed in the spring and summer semesters of 2014 in order to seek their perspectives on (1) the extent of their engagement in the courses and (2) the degree to which their instructors promoted their engagement. The survey comprised three sub-scales: the first and third sub-scales addressed instructional design aspects of the course, and the second sub-scale addressed attitudes and behaviors whereby the instructors promoted student engagement. The results showed a significant difference on the second sub-scale (sig = 0.003) at the .05 level, indicating that students rated instructors with professional development higher on instructor behaviors that engaged them in their courses than those instructors who received no professional development. There were no significant differences found for the first and third sub-scales indicating that the instructional design aspects of the courses under investigation were not influenced by instructors' professional development. Qualitative data showed that three quarters of the students who had instructors whose background included professional development geared to encouraging student engagement felt that their courses had engaged them. Future research will focus on increasing the response rate and exploring in more depth both the instructional design and qualitative aspects of student engagement.
Locus of Authority: The Evolution of Faculty Roles in the Governance of Higher Education
The practice of shared governance is contested terrain in American higher education. Despite consensus that shared governance is a collaborative approach to decision-making characterized by the distribution of authority across various institutional actors (e.g., faculty, senior administrators, trustees), models and norms of effective shared governance remain elusive. Indeed higher education critics within and beyond the academy often identify the practice of shared decision-making as a major barrier to innovation and fiscal efficiency, two organizational qualities deemed essential for survival in today's rapidly changing global knowledge economy.
Distance Education Readiness Assessments: An Overview and Application
With the rise in online and hybrid courses at the post-secondary level, many institutions are offering various online learning readiness assessments to students who are considering these instructional formats. Following a discussion of the characteristics often attributed to successful online learners, as well as a review of a sample of the publicly available online readiness surveys, an application of one representative tool is described. Specifically, the Distance Education Aptitude and Readiness Scale was administered in both hybrid and face-to-face sections of beginning post-secondary French across a two-year span. Differences in scores between groups, as well as the relationship between scores and grades are examined.
The Moral Bankruptcy of Corporate Education
This commentari is contextualized in America's gilded age of corporate education caharacterized by millionaire CEO university presidents and a growing chasm of wealth inequality in our educational system. America's deepening educational stratification mirrors and magnifies wider social, economic, racial, and political inequality and injustice.
STUDENT DEBT AND THE CLASS OF 2013
Student Debt and the Class of 2013 is our ninth annual report on the cumulative student loan debt of recent graduates from four-year colleges. Our analysis of available data finds debt levels continue to rise, with considerable variation among states as well as colleges.
About seven in 10 (69%) college seniors who graduated from public and private nonprofit colleges in 2013 had student loan debt. These borrowers owed an average of $28,400, up two percent compared to $27,850 for public and nonprofit graduates in 2012. About one-fifth (19%) of the Class of 2013's debt was comprised of private loans, which are typically more costly and provide fewer consumer protections and repayment options than safer federal loans.
Clarity and confusion? The new jurisprudence of aboriginal title
The Supreme Court of Canada has revolutionized the jurisprudence of aborig-inal rights and title. Various decisions have overturned the doctrine of adverse occupancy, which at one time had been thought to have extinguished aborig-inal title in British Columbia (Delgamukkw); created a governmental duty to consult First Nations regarding use of land to which they have a claim of aboriginal rights or title (Haida Nation); approved a specific claim to aborig-inal title (Tsilhqot'in); and extended the duty of consultation to First Nations whose aboriginal title was previously thought to have been extinguished by treaty (Mikisew). These decisions have created a new range of property rights for First Nations, which they should be able to use to advance their prosper-ity. However, the new jurisprudence has also set up many barriers to volun-tary market transactions by multiplying the number of owners and claimants, and laying down opaque und unpredictable rules for making decisions about lands that are subject to claims of aboriginal title or to treaty rights such as hunting and fishing.


text:
Q: Given a language $L$, is there a name/notation for the set $\{w^{n}\mid w\in L, n\in\mathbb N\}$? Given a language $L$, consider the operator $$\overset{*}{L}\triangleq\{w^{n}\mid w\in L, n\in\mathbb N\}.$$
This means that each word in $\overset{*}{L}$ contains of a word in $L$, concatenated to itself some number of times. Notice that this is different than $L^*$ which allows concatenation of different words in $L$.

Is there a name / known notation for this operator?

A: I would write it as follows
$$
 \bigcup_{w \in L} w^*
$$

redpajama_set_name: RedPajamaStackExchange


We are privileged to have Mr. David Briggs as our guest blogger today.
"Where is my American dollar?", asked the young man as he came running up to me with his hand held out and his eyes fixed squarely into mine. I had just landed at the airport in Port – au – Prince, Haiti where I had cleared customs and walked out of the arrivals hall and found myself in the midst of a very crowded and congested passenger pick up area. "Where is my Haitian dollar?", I snapped back as I held my open hand out to him as if I was expecting or demanding that he put something in it. He stood their silently looking just as much shocked as he did surprised, while I watched him stand almost perfectly still trying to process the unexpected response that I gave him and the thing which I had asked him. Then he smiled timidly and replied, "No, you are the rich American, you are supposed to give me something." These words glared out at me as though they were written across a billboard written in bright blinking neon lights. His expressed logic kept running over in my head, "You are rich, so you are suppose to give me something." What a tragedy, what a debilitating mindset to be ingrained into the thinking of a young man at such an early age that he felt that it was "his right" and "my obligation" to sustain him financially because of our different stations in life and our different fortunes. This type of thinking had crippled this young man's thinking and limited his ability to see who he really was and what he could become. It had kept him poor and made him a ward of the pity of the rich while crushing his ability to dream or believe that his station in life could be changed and he could become someone greater and do something greater. He had abandoned all ability and creativity in his life and resigned himself to be a beggar. Because of this entitled mindset he didn't believe he had any responsibility to change his station in life. It broke my heart and angered me all at the same time. He was a strong young man with incredible potential and a sharp mind and a very charismatic personality who was robbed from empowerment and crippled by the philosophy of benevolence, which had left him trapped in a prison of poverty and emotional despair.
I felt compelled to do something to open his eyes to the possibilities that were there for him. To plant even one seed of desire that could motivate him to reach for something different, something liberating that could change his destiny. Or at least change his standard of living and release him from the dependence on the pity of others to sustain his meager existence.
Great article Billy. So often people go for the "quick fix" which is no fix at all. There is no future in enabling – especially for the other person!


An event organized by it Consult, in collaboration with Microsoft.
Knowledge Box Spring 2012 is a national convention on the topic of Organization Intelligence, the evolution of Knowledge Management.
A traditional appointment for a decade not, it is aimed at the managers of public and private organizations and is marked by a pragmatic approach with the presentation of business experiences and qualifying technologies.


Labor needs representation and many of the values that drew millions of working Americans into the labor movement endure. But few American institutions are as ill suited to the 21st century or have proved so inept at reorganization and reform as the unions.
Labor is so enamored of its glorious past that it has failed to respond to the challenges of the future. The price for this failure is already high, and it is likely to climb.


text:
\subsection{Vision transformer models}
\label{ssec:vit}

Inspired by the success of transformer models in NLP tasks, recent research proposes to use transformer models on computer vision tasks. The inspiring vision transformer (ViT)~\citep{dosovitskiy2020image} demonstrates the possibility of performing high-accuracy image classification with transformer architecture only, yet also finds that learning attention between image patches is a challenging task that requires large training set and model size. This stimulates recent works to ease extensive pretraining and improve the efficiency-accuracy tradeoff. One noticeable approach DEIT~\citep{touvron2021training} provides carefully designed training schemes and data augmentation techniques to train ViT from scratch on ImageNet only.
Another line of work renovates ViT transformer blocks to better capture image features, such as changing input tokenization~\citep{yuan2021tokens,graham2021levit}, using hierarchical architecture~\citep{liu2021swin,wang2021pyramid,graham2021levit}, upgrading positional encoding~\citep{chu2021conditional}, and performing localized attention~\citep{liu2021swin,han2021transformer}, bringing in further accuracy improvements under similar computation cost.

In this work we focus on the original ViT architecture~\citep{dosovitskiy2020image} amid its widespread usage, as illustrated in the top of Figure~\ref{fig:overall}.
ViT model first divides the input image into patches that are tokenized to embedding dimension $E$ through a linear projection. Image tokens, together with an independently initialized \textit{class token}, form an input $x\in \mathbb{R}^{N\times E}$. Input tokens pass through transformer blocks before classification is made from the class token output of the last block.

In its simplest form, a ViT block includes a multi-head self attention (MSA) and a multi-layer perceptron (MLP) module. The MSA module first linearly transforms the $N\times E$ tokens into queries $q\in \mathbb{R}^{N\times (QK\times H)}$, keys $k\in \mathbb{R}^{N\times (QK\times H)}$, and values $v\in \mathbb{R}^{N\times (V\times H)}$. The $q$, $k$ and $v$ are then split into $H$ heads. Each head performs the self-attention operation defined in Equation~(\ref{equ:msa}) in parallel:
\begin{equation}
\label{equ:msa}
    \text{Attn}(q_h, k_h, v_h) = \text{softmax}\left(\frac{q_h k_h^T}{\sqrt{d_h}}\right) v_h,
\end{equation}
where $\frac{1}{\sqrt{d_h}}$ is the scaling factor, and $q_h \in \mathbb{R}^{N\times QK}$, $k_h \in \mathbb{R}^{N\times QK}$ and $v_h \in \mathbb{R}^{N\times V}$ are the query, key and value of head $h$. The output of all the heads are then concatenated prior to a fully-connected (FC) linear projection back to the original dimension of $\mathbb{R}^{N\times E}$.
Note that though previous works set dimension $QK = V$ in designing the model architecture~\citep{dosovitskiy2020image,touvron2021training,chen2021autoformer}, setting them differently will not go against the shape rule of matrix multiplication.
The MLP module includes two FC layers with a hidden dimension of $M$.
The output of the last FC layer preserves token dimension at $\mathbb{R}^{N\times E}$.

Built upon the original ViT, DEIT models~\citep{touvron2021training} further exploit a \textit{distillation token}, which learns from the output label of a CNN teacher during the training process to incorporate some inductive bias of the CNN model, and significantly improves the DEIT accuracy.

Our work uses the DEIT model architecture as a starting point, where we explore the potential of compressing the model and better allocating of the dimensions of different blocks for enhanced efficiency-accuracy tradeoff. Our method is also applicable to other vision transformer architectures for further efficiency improvements, which will be explored in future works.

\subsection{ViT compression techniques}

Despite rapid progress of ViTs for vision tasks, ViT blocks still heavily inherit the architecture of transformers for NLP tasks~\citep{vaswani2017attention}, \textit{e.g.,} the dimension of each block is determined without much optimization, and all the blocks in the stacked model architecture share the same dimension. As we will show later, such design may not be optimal for computer vision tasks.

To improve model efficiency, very recent works successfully use structural pruning techniques on vision transformer models, with trainable gate variables~\citep{zhu2021visual} or Taylor importance score~\citep{chen2021chasing}.
Both methods show the potential of compressing ViT models, yet only consider part of the prunable architecture like the number of heads or the MLP hidden dimension, use manually designed sparsity distribution, and do not take run time latency into account, thus may not lead to optimal compressed models. Our method resolves these issues through a latency-aware global structural pruning of all prunable components across all layers in a jointly manner.

Besides pruning, AutoFormer~\citep{chen2021autoformer} uses a neural architecture search (NAS) approach to search for efficient ViT models.
AutoFormer only explores a small number of dimension choices, due to the constraint on the supernet training cost; while our method continuously explores the entire design space of ViT model with a single training process, leading to the finding of more efficient architectures with less training cost.
Most importantly, our pruning scheme successfully leads to a scalable design rule, where we can easily design efficient vision transformer models at different scales. This has never been attempted in previous works.

There has been a series of research on improving the efficiency of attention-based models on NLP tasks, specifically pruning the number of heads in the MSA block.
This includes utilizing stochastic binary gate~\citep{louizos2017learning,voita2019analyzing}, pruning with sensitivity score~\citep{michel2019sixteen} and exploring lottery ticket hypothesis~\citep{frankle2018lottery,behnke2020losing}. Our work aims on pruning all parameters including heads, and therefore, has a larger pruning space.

Other great ways of improving the efficiency of transformers include weight sharing across transformer blocks~\citep{lan2019albert}, dynamically controlling the attention span of each token~\citep{chen2019adaptive,tambe2020edgebert}, and allowing the model to output the result in an earlier transformer block~\citep{zhou2020bert,schwartz2020right}. These techniques are orthogonal to our pruning-based method and have remained unexplored on vision models. Applying them on ViT models and combining with our pruning method would be an interesting and fruitful future direction.

\subsection{Identifying prunable structures}
\label{ssec:dim}

\begin{figure}[htb]
\centering
\captionsetup{width=0.9\linewidth}
\includegraphics[width=1.0\linewidth]{images/Section_3.1_Danny_V2.pdf}
\caption{Attention block reshaping for latency-friendly structural pruning. We reshaped the QKV projection and final output projection in the attention block to explicitly control the number of head and align the QK \& V dimensions in each head head.}
\label{fig:prune2}
\vspace{-10pt}
\end{figure}

In this work, we focus on pruning all the independent structural components in ViT, namely:
\begin{itemize}[leftmargin=*]
    \item The embedding dimension shared across all blocks, denoted as \textit{EMB};
    \item The number of heads in MSA for every block, denoted as \textit{H};
    \item The output dimension of Q and K projection per head in MSA, denoted as \textit{QK};
    \item The output dimension of V projection and input dimension of the PROJ per head, denoted as \textit{V};
    \item The hidden dimension of MLP per block, denoted as \textit{MLP}.
\end{itemize}

Note that this is slightly different from the dimensions we showed in Section~\ref{ssec:vit}.
As highlighted on the left of Figure~\ref{fig:prune2}, in a typical ViT implementation, the QKV projection output dimensions are a concatenation of all the attention heads~\citep{rw2019timm}, effectively $QK \times H$ or $V \times H$. The projected tokens are then split into $H$ heads to allow the computation of MSA in parallel. If we directly prune this concatenated dimension, then there is no control on the remaining QK and V dimension of each head. Therefore, the latency of the entire MSA will be bounded by the head with the largest dimension.

To alleviate such inconsistency between pruned head dimensions, we explicitly control the number of heads and align the QK and V dimension remaining in each head. As illustrated on the right of Figure~\ref{fig:prune2}, for model pruning we reshape the weight of Q, K, V and PROJ projection layers to single out the head dimension \textit{H}. Performing structural pruning on the reshaped block along the H dimension will enable the removal of an entire head, while pruning along the QK/V dimension guarantees the remained QK and V dimension of all the heads are the same.
This reshaping is only applied during the pruning process, while the final pruned model is converted back to the concatenated scheme.
Note that H, QK, V and MLP in different blocks can all be independently pruned. While the H dimension should be kept the same for all Q, K, V and PROJ weights within each block. Finally, EMB needs to be kept the same for all the blocks due to the shortcut connections.

A comparison of this latency-friendly pruning scheme with directly applying structural pruning on the concatenated $QK \times H$ and $V \times H$ dimension is provided in Appendix~\ref{ap:scheme}, where we demonstrate lower latency and higher accuracy can be achieved with our pruning scheme.

\subsection{Structural pruning criteria}
\label{ssec:procedure}

\subsubsection{Global importance ranking}

Structural pruning aims to find a model with weights $\mathbf{W}$, under a certain model size constraint $C$, that leads to the minimal loss $\mathcal{L}(\mathcal{D},\mathbf{W})$ on dataset $\mathcal{D}$. This can be solved by optimization as:
\begin{equation}
    \min_{\mathbf{W}} \mathcal{L}(\mathcal{D},\mathbf{W}),\ s.t.\ \left| \left| \sum_{s\in \mathcal{S}}|w_s| \right| \right|_0 \leq C,
\end{equation}
where $w_s$ is an element in the structural group $\mathcal{S}$ of weight $\mathbf{W}$.
Unfortunately, the optimization under $\ell_0$ norm constraint is known to be non-convex, NP hard and requires inefficient combinatorial search.

As an alternative, previous research relaxes the full combinatorial search with an iterative greedy search scheme~\citep{guo2016dynamic,he2017channel,molchanov2019importance}. Under this scheme, starting with well-trained parameters $\mathbf{W}$ achieving $\min_{\mathbf{W}} \mathcal{L}(\mathcal{D},\mathbf{W})$, we greedily remove a few structural groups at a time based on their importance scores, until the targeted constraint is achieved.
The expected squared perturbation in the loss function by setting the group $\mathcal{S}$ to 0 is equal to:
\begin{equation}
\label{equ:loss_inc}
    \mathcal{I}_{\mathcal{S}} =  \Big ( \mathcal{L}(\mathcal{D},\mathbf{W}|w_s=0) - \mathcal{L}(\mathcal{D},\mathbf{W}) \Big) ^2.
\end{equation}

To efficiently evaluate $\mathcal{I}_{\mathcal{S}}$ in Equation~(\ref{equ:loss_inc}), instead of calculating the loss difference for each group, we perform a first-order Taylor expansion of the loss value with pruned weights, as:
\begin{equation}
    \mathcal{L}(\mathcal{D},\mathbf{W}|w_s=0) = \mathcal{L}(\mathcal{D},\mathbf{W}) + \sum_{s\in \mathcal{S}} g_s w_s,
\end{equation}
where $g_s = \partial \mathcal{L} / \partial w_s$ denotes the gradient of training objective with respect to $w_s$. Substituting this approximation into Equation~(\ref{equ:loss_inc}) leads to a simplified importance score:
\begin{equation}
\label{equ:imp_sim}
    \mathcal{I}_{\mathcal{S}}(\mathbf{W}) = \left(\sum_{s\in \mathcal{S}} g_s w_s\right)^2.
\end{equation}

Since the gradients with respect to all weight elements are already available from backpropagation, the importance score in Equation~(\ref{equ:imp_sim}) can be easily calculated during the finetuning process without additional cost. Unlike the magnitude of the weight being in various ranges in different layers, the Taylor-based importance score can be compared among all layers of weight as a global pruning criteria as it reflects the contribution of the weight to the loss value, as shown to be very effective for CNN filter pruning~\citep{molchanov2019importance,ding2019global,yin2020dreaming,chawla2021data}.

In this work we further show that Taylor importance score of different groups can be biased to encourage more intense pruning of some parameters. The simplest solution would be to set a multiplier per structural group. As explained in Appendix~\ref{ap:config}, we divide importance of H by 6 to encourage removal of heads.

Pruning can be tailored towards latency reduction by penalizing the importance score with latency-aware regularization:
\begin{equation}
    \label{equ:imp}
    \mathcal{I}^L_{\mathcal{S}}(\mathbf{W}) = \mathcal{I}_{\mathcal{S}}(\mathbf{W}) - \eta \Big( {\text{Lat}}(\mathbf{W})-{\text{Lat}}(\mathbf{W}\backslash \mathcal{S}) \Big).
\end{equation}
$\text{Lat}(\cdot)$ denotes the latency of the current model, which is characterized by a lookup table of attention block latency given the current EMB, H, QK, V, and MLP dimension of each block in the pruned model. Details of the latency lookup table are provided in Appendix~\ref{ap:lat}, where we show a small lookup table can achieve accurate latency estimation throughout the pruning process.
We use $\mathcal{I}^L_{\mathcal{S}}$ as the pruning criteria for iterative pruning in our work, with detailed procedure in Appendix~\ref{ap:config}. A compact and dense model can be achieved by removing pruned groups and recompiling the model.

\subsubsection{Ampere (2:4) GPU sparsity}

\begin{figure}[htb]
\centering
\captionsetup{width=0.9\linewidth}
\includegraphics[width=0.8\linewidth]{ASP.png}
\caption{Illustration of 2:4 Ampere sparsity. In every 4 consecutive weight elements the two with the smallest magnitude are set to zero (denoted as blank spaces on the right).}
 \vspace{-4pt}
\label{fig:asp}
\end{figure}

Emerging software and hardware developments have brought support to the acceleration of a more fine-grained sparsity patterns. The recently introduced NVIDIA Ampere GPU architecture supports acceleration of sparse matrix multiplication with a specific pattern of 2:4 sparsity (2 of the 4 consecutive weight elements are zero, see Figure~\ref{fig:asp}). This comes with a limitation of requiring the input and output dimensions of all linear projections to be \textbf{divisible by 16}~\citep{mishra2021accelerating}. We assure compatibility with such pattern by structurally pruning matrices to have the remaining dimension be divisible by 16 (more details in Appendix~\ref{ap:config}). Interestingly, we find that Ampere sparsity can be performed by just magnitude pruning with \textbf{no accuracy drop} after the initial pruning is finished.

\subsection{Training objective}
\label{ssec:objective}

We next consider the training objective function that supports both pruning for importance ranking and finetuning for weight update. To start with, we inherit the CNN hard distillation training objective as proposed in DEIT~\citep{touvron2021training}, which is formulated as follows:
\begin{equation}
    \label{equ:CNN}
    \mathcal{L}_{\text{CNN}} =\mathcal{L}_{\text{CE}} \Big( \Psi(z^s_c),Y \Big)+ \mathcal{L}_{\text{CE}} \Big(\Psi(z^s_d),Y^{\text{CNN}} \Big),
\end{equation}
where $\Psi(\cdot)$ denotes softmax and $\mathcal{L}_{\text{CE}}$ the cross entropy loss. We refer to logits computed from the \textit{class token} of the pruned model as $z_c^s$, and the one computed from the \textit{distillation token} as $z_d^s$. Note that $z_c^s$ is supervised by the true label $Y$, while $z_d^s$ is supervised by the output label of a CNN teacher $Y^{\text{CNN}}$ to capture the inductive bias of CNN through attention. Unless otherwise stated, we use a pretrained RegNetY-16GF model~\citep{radosavovic2020designing} as the teacher, in line with DEIT.

In addition to CNN distillation, we consider \textit{full model distillation} given the unique access to such supervision under the pruning setup. Specifically, the ``full model'' corresponds to the pretrained model, which serves as the starting point of the pruning process.
Ideally a pruned model shall behave similar to its original counterpart. To encourage this, we distill the classification logits from both the class and distillation tokens of the pruned model from the original counterpart, forming Equation~(\ref{equ:full}):
\begin{equation}
    \label{equ:full}
    \mathcal{L}_{\text{full}} = \mathcal{L}_{\text{KL}} \Big(\Psi(\tau z^s_c),\Psi(\tau z^t_c)\Big)+\mathcal{L}_{\text{KL}}\Big(\Psi(\tau z^s_d),\Psi(\tau z^t_d)\Big).
\end{equation}
Superscripts $^t$ and $^s$ represent the output of the full pretrained model and the model being pruned respectively. $\mathcal{L}_{\text{KL}}$ denotes the KL divergence loss, and $\tau$ is the distillation temperature.

The final objective is therefore composed as: $\mathcal{L} = \alpha \mathcal{L}_{\text{full}} + \mathcal{L}_{\text{CNN}}$.
An ablation study of alternating the formulation of the training objective is provided in Appendix~\ref{ap:obj}.

\subsection{Pruning analysis on ImageNet-1K}

We evaluate our pruning method on the challenging ImageNet-1K benchmark, using the DEIT-Base model pretrained with CNN distillation as the starting point. The model size, run time speedup and accuracy of the state-of-the-art methods and our method are compared in Table~\ref{tab:full_compress}. The training and finetuning hyperparameters can be found in Appendix~\ref{ap:hyper}, and details for our pruning configurations can be found in Appendix~\ref{ap:config}.

For best insights, we conduct pruning in four configurations, where we refer to our pruning scheme as Novel ViT Pruning (NVP):
\begin{itemize}[leftmargin=*]
    \item \textbf{NVP-B} aims to match the accuracy of DEIT-B model, which achieves an 1.86$\times$ speedup and a 2.57$\times$ reduction on FLOPs over DEIT-B with neglectable 0.07\% accuracy drop. It also achieves a 2.25$\times$ further FLOPs reduction over the more efficient SWIN-B transformer under same accuracy.
    \item \textbf{NVP-H} aims to half the run time latency of DEIT-B, with only 0.4\% accuracy loss. It also achieves 1.41$\times$ further reduction on FLOPs over SWIN-S with similar accuracy.
    \item \textbf{NVP-S} aims to match the latency of DEIT-S model, with $1 \%$ higher accuracy.
    \item \textbf{NVP-T} aims to match the latency of DEIT-T model, with $1.7 \%$ higher accuracy.
\end{itemize}

The model size-accuracy tradeoff also outperforms previous model compression methods like SViTE and AutoFormer by a large margin.
Since our pruning scheme supports the utilization of Ampere sparsity on advanced GPU architectures, with the help of Apex ASP~\citep{mishra2021accelerating}, an additional 5\% speedup can be achieved on our pruned models without further accuracy loss.

\input{tables/imagenet_pruning}

\subsection{Trends observed in ViT pruning}
\label{ssec:heur}
As observed by~\citet{liu2018rethinking}, channel/filter pruning in CNN models can provide guidance on finding efficient network architectures, yet this has never been explored on ViT models. Here we show \textit{for the first time} that our pruning method can serve as an effective architecture search tool for ViT models, and more interestingly the inferred design rules are scalable to different model sizes.

As we prune the ViT model to different sizes, we observe the following insights in the way the model architecture changes, as visualized by the gray lines of Figure~\ref{fig:heur}:
\begin{itemize}[leftmargin=*]
    \item Number of heads, QK of each head and MLP scales \textit{linearly} with the dimension of EMB; while V of each head can be largely kept the same;
    \item The scaling factors of head, QK and MLP are \textit{not uniform} among all blocks: dimension is larger in the blocks in the middle and smaller towards the two ends;
    \item The first and last blocks require \textit{larger} dimensions compared to neighboring blocks;
    \item \textit{Reducing} dimensions related to the multi-head attention (H, QK, V) while \textit{increasing} MLP dimension may lead to more accurate model under similar latency.
\end{itemize}

Compared to ViT, our insight shows the need to scale QK of each head with the EMB size, and more importantly to allow different transformer blocks in the model to have different dimensions. Interestingly, these trends are not observed in NLP transformer compression~\citep{michel2019sixteen,voita2019analyzing}. Appendix~\ref{ap:intuition} discusses intuitive hypothesis on why these trends appear in ViT, as we show a similar \textbf{less-more-less} trend in the attention score diversity among all heads of each block, which potentially reflects how much redundancy appears in each block.

\begin{figure}[htb]
\centering
\captionsetup{width=0.9\linewidth}
\includegraphics[width=1.0\linewidth]{heuristic.png}
\caption{Model dimension comparison between NViT (green), DEIT (blue) and pruned NVP model (grey). Compared to DEIT, the pruned model has more parameters in blocks towards the middle and in MLP; but fewer parameters in blocks towards the two ends and in MSA (H and QK). We follow these insights closely in the design of our NViT models.}
\label{fig:heur}
 \vspace{-10pt}
\end{figure}

\subsection{NViT design and performance}
\label{ssec:nvit}
\textbf{NViT design rule.} Our pruning insights lead to a redistribution of parameters and a new architecture we name \textit{NViT}. We follow the trends in Figure~\ref{fig:heur} and smooth them out to simplify the architecture, shown with green lines. More specifically, we redistribute the parameters in ViT models in a more efficient manner, using a simplified rule in Table~\ref{tab:heur_sim} to determine the parameter dimensions of each block based on embedding size EMB and a single scaling factor $\epsilon$.
We use EMB as the main driving factor for model scaling, as it leads to the most drastic change in size and performance compared to other structural components, as shown in the single component pruning results in Appendix~\ref{ap:ind}.
Since the first and last attention blocks are typically more important, we set the dimension of them separately.
For a 12-layer vision transformer model, we use $\epsilon = 2$ for block 4-9, and use $\epsilon = 1$ for other intermediate blocks. H is rounded to the nearest even number, and QK rounded to the nearest number divisible by 8 to satisfy the dimension requirement of Ampere GPUs.

\begin{table}[htb]
  \caption{\small \textbf{NViT block dimensions.} For comparison the dimensions of a DEIT block are also listed.}
  \label{tab:heur_sim}
  \centering
  \resizebox{0.6\textwidth}{!}{
  \begin{tabular}{c|cccc}
    \toprule
    Blocks  & H   & QK    & V     & MLP  \\
    \midrule
    DEIT    & EMB/64 & 64 & 64 & EMB$\times$4 \\
    \midrule
    First/last       & 10       & EMB/10 & 64 & EMB$\times$3  \\
    Intermediate     & $\epsilon \times$EMB/100 & $\epsilon \times$EMB/20 & 64 & $\epsilon \times$EMB$\times$3  \\
    \bottomrule
  \end{tabular}
  }
\end{table}

\textbf{Scalability.} We next demonstrate the scalability of the proposed NViT architecture through providing a set of variants that match the latency of the models in DEIT family, as specified by the embedding size in Table~\ref{tab:nvit}. Figure~\ref{fig:heur} compares the dimensions of NViT models vs.\ the DEIT models vs.\ our pruned model with a similar accuracy (for base) or latency (for small and tiny), where we show that the NViT architecture well approximates the trend observed in the pruned model.

\textbf{Comparison.} To verify that our NViT parameter redistribution is beneficial, we train all pairs of DEIT and NViT models from scratch on the ImageNet-1K benchmark with the same training objective and hyperparameter choices, which are specified in Appendix~\ref{ap:hyper_he}. As shown in Table~\ref{tab:nvit}, our redistribution lets NViT achieve higher accuracy than DEIT with similar FLOPs and lower latency. Specifically, NViT-B, NViT-S and NViT-T achieve a Top-1 accuracy gain of 0.11\%, 0.21\% and 1.07\%, respectively, over their DEIT counterparts.

\begin{table}[htb]
  \caption{\small \textbf{Comparing NViT models with DEIT model family.} All compression ratios and speedups are computed with respected to that of the DEIT-Base model. Latency was estimated on an RTX 2080 GPU. DEIT accuracy marked with * indicates the train-from-scratch accuracy we achieve from the DEIT GitHub repo\tablefootnote{} using default hyperparameters\tablefootnote{}, which is slightly lower than the reported accuracy in DEIT paper. \textbf{All pairs of models are trained from scratch with the same hyperparameters from the official DEIT-B script.}}
  \label{tab:nvit}
  \centering
  \resizebox{0.7\textwidth}{!}{
  \begin{tabular}{c|ccccc}
    \toprule
    Model & EMB   & \#Para ($\times$)   & \#FLOPs ($\times$) & Speedup ($\times$) & Accuracy (\%)     \\
    \midrule
    DEIT-B   & 768 & 86M (1.00)      & 17.6G (1.00) & 1.00  & \ \ 82.99*    \\
    \rowcolor{lgreen}
    \textbf{NViT-B}   & 720 & 86M (1.00)   & 17.6G (1.00)  & 1.01 & \textbf{83.10}    \\
    \midrule
    DEIT-S   & 384 & 22M (3.94)   & 4.6G (3.82)  & 2.29 & \ \ 81.01*    \\
    \rowcolor{lgreen}
    \textbf{NViT-S}   & 384 & 23M (3.75)   & 4.7G (3.75)  & 2.31 & \textbf{81.22}    \\
    \midrule
    DEIT-T   & 192 & 5.6M (15.28)  & 1.2G (14.01) & 4.39 & \ \ 72.84*    \\
    \rowcolor{lgreen}
    \textbf{NViT-T}   & 192 & 6.4M (13.34)  & 1.3G (13.69) & 4.53 & \textbf{73.91}    \\
    \bottomrule
  \end{tabular}
  }
\end{table}
\footnotetext[1]{Available at \url{https://github.com/facebookresearch/deit}.}
\footnotetext[2]{As in Table 9 of~\citet{touvron2021training}.}

\subsection{Downstream tasks}

\begin{table}[htb]
  \caption{\small \textbf{Transfer learning tasks performance with ImageNet pretraining.} We report the Top-1 accuracy of finetuning the ImageNet trained models on other datasets. DEIT-B~\citep{touvron2021training} and ViT-B~\citep{dosovitskiy2020image} results as reported by~\citet{touvron2021training} are provided for reference. Speedup evaluated on RTX 2080 GPU with respect to DEIT-B.
  \label{tab:downstream}
  \centering
  \resizebox{0.8\textwidth}{!}{%

  \begin{tabular}{c|cccc|c}
    \toprule
    Model & CIFAR-10 (\%) &  CIFAR-100 (\%) &  iNat-18 (\%) & iNat-19 (\%) & Speedup ($\times$) \\
    \midrule
    DEIT-B & 99.1 & 91.3 & 73.7 & 78.4 & 1.00 \\
    ViT-B/16 & 98.1 & 87.1 & - & - & 1.00\\
    \midrule
    DEIT-T & 97.93 & 85.66 & 62.41 & 72.08 & 4.39  \\
    \rowcolor{lgreen}
    \textbf{NViT-T}   & 98.18 & 85.68 & 63.43 & 73.73 & \textbf{4.53}  \\
    \rowcolor{lgreen}
    \textbf{NVP-T}  & \textbf{98.31} & \textbf{85.88} & \textbf{64.78} & \textbf{74.65} & 4.48  \\
    \bottomrule
  \end{tabular}%

  }
\end{table}

Finally, we evaluate the generalization ability of our pruned models and the derived NViTs with transfer learning. Here we finetune the ImageNet trained DEIT, NViT and pruned models on CIFAR-10, CIFAR-100~\citep{krizhevsky2009learning}, iNaturalist 2018 and 2019~\citep{van2018inaturalist} dataset respectively. The detailed information of these datasets and our training configuration for the downstream tasks are available in Appendix~\ref{ap:downstream}. The transfer leaning results are provided in Table~\ref{tab:downstream}. Pruned models consistently outperform the DEIT models on all the tasks, while NViT models achieve a better performance than DEIT with better speedup. These observations show that the efficiency demonstrated on ImageNet can be preserved on downstream tasks.

\section{Introduction}
\input{1_intro}

\section{Related work}
\input{2_related_work}

\section{Latency-aware global structural pruning}
\input{3_method}

\section{Parameter Redistribution \& NViT}
\input{4_exp}

\section{Conclusions}

This work proposes a latency-aware global pruning framework that provides significant lossless compression on DEIT-Base model, facilitating the finding of simple design heuristics for novel efficient vision transformers (NViT) with consistent performance improvements.
We hope this work opens up a new way to better understand the contribution of different components in the ViT architecture, and inspires more efficient ViT models.

\subsubsection*{Reproducibility statement}

We have included details on how to reimplement our work. For structural pruning experiments, we provide the hyperparameter choices in Appendix~\ref{ap:hyper_ft}, and the implementation details with link to full model checkpoints in Appendix~\ref{ap:config}. Details of the latency lookup table are included in Appendix~\ref{ap:lat}. The NViT models have all dimensions specified in Section~\ref{ssec:nvit}, with training hyperparameters available in Appendix~\ref{ap:hyper_he}. The dataset details and hyperparameters used in our downstream task experiments are available in Appendix~\ref{ap:downstream}.

\medskip

\small

\bibliographystyle{iclr2022_conference}

redpajama_set_name: RedPajamaArXiv


From small businesses, hobbyists, fabulous bloggers to large corporations, everyone wants to know the secret online marketing sauce that will place your website on page one of Google. Search Engine Optimization, content marketing, inbound marketing and digital marketing, these tactics are now your "need-to-know" for business success.
Let's begin with your industry. Do an online search for a keyword or phrase, such as, "weight loss supplements", and what do you see? You will discover about eight businesses that invest in Google AdWords Advertising; creating a very competitive marketplace. What does this mean for your business? It means you need to invest in creating original, unique, informative, good quality content on your website is key to gaining high search engine ranking.
Did I say it is all about the content?
Of course, do invest in SEO and update your site to make it mobile-friendly. You need to do these too. What I am saying is that the right content will increase website traffic, build online sales and leadership think. Great content will also help to build back links, and this is the one SEO tactic that has not changed and continues to work for any website.
What makes great content? Your content needs to provide something that people will relate to or use in a helpful way whether it is to grow their business or grow their roses. Because the one thing that hasn't changed is our desire to have a shared and unique experience with like-minded people. Shareable experiences from company events, concerts, trade shows, a spa day with friends, family dinner parties and now we expect the same when we're online.
Let's make something clear, if you are a B2B company making industrial pressure washers or generic white buttons, it can be difficult to create a 'shared experience.' Difficult but not impossible.
1. CLEAR goals. B2B companies will be off base with their online goals because of their target market's purchasing patterns has changed, and a weak competitive analysis. Let me break it down for you, are you looking to grow website traffic, build lead generation or increase online sales?
2. WRITE epic. A practical and useful post are more likely to be shared than content that is generic or a weak version of your competitor's. When creating content, you always need to be asking, is this the type of content that your target market is searching to read? Does this content provide value to help them during their purchasing funnel? Does this content create leadership-think for our brand?
3. GUESTS bloggers. Being a guest blogger and inviting guest bloggers does increase traffic, which can lead to more referrals and clients. And, that's all she wrote, folks!
4. PROMOTE posts. Share, tweet and share some more. Just be sure to know your industry, as I mentioned at the top of this post, you could be in a not sharing industry. As a result, you may need to invest your marketing dollars in pay-per-click, online advertising, taking the time to share content yourself on other sites and promoting your content on social media platforms. Know your industry and influencers.
5. CREATE funnels. Some content should be part of your marketing funnel program. Case studies, webinars, and ebooks are all favorite reads and people quickly provide their email address to receive well-written, insightful content that offers actionable advice.
After reading this, I know what you're thinking, I'm hiring another sales person!!
Don't give up. Give us a call, or email me directly at cecilia@themarketingboutique.net and we'll go over your goals and concerns, I'm sure we can help you with your online goals!


Chinese e-commerce giant Alibaba is about to set up an office in Australia, opening a giant opportunity for sellers.
When US internet giants mention Australia in passing – let alone actually visit the country or establish operations here – they are usually showered with media coverage.
But when China's most valuable internet company, Alibaba, announced plans to open an office in Australia last week, it barely registered a whimper.
Alibaba, the e-commerce colossus that processed transactions worth $US149 billion in the December quarter alone, said at an event in Hangzhou last week it would open an Australian office "later this year".
Jack Ma, executive chairman of the Alibaba Group, is now worth an estimated $US23 billion.
And Fairfax Media has learned it has already made one senior hire for that office: James Hudson, the chief executive of the NSW branch of the Australia-China Business Council, will join the business next month. John O'Loghlen, a New Zealand-born entrepreneur, has also joined the company, it said this week.
It is a significant development for the Australian retail sector. Yet as the Prime Minister and a 1000-strong business delegation swept through the world's second-largest economy last week, far more trivial announcements, such as the Australian Football League's plan to play a regular season game in the country next year, captured all the attention.
Alibaba, founded by entrepreneur Jack Ma and listed on the New York Stock Exchange with a market value of nearly $US200 billion, has had a senior executive, Maggie Zhou, in charge of the Australia and New Zealand region for at least two years. But she travels between China and Australia and has been based primarily in Hangzhou.
The company signalled that the move to establish an Australian office is designed to help local brands tap into the gigantic Chinese market, where Alibaba has 407 million active buyers on its platforms. However, the decision to establish a fully-fledged office in Australia will fuel speculation it sees an opportunity for Australian consumers to buy products on its sites.
"We see a lot of potential in the Australian market as Alibaba continues its globalisation efforts," the company said in an emailed statement. It declined to provide any further details on its plans.
Australia ranked as the fifth top-selling country into China during the company's global shopping festival last year, Alibaba said.
A number of Australian retailers, including Woolworths, Bellamy's, Blackmores and Chemist Warehouse, have signed up to officially sell products on Tmall, Alibaba's Chinese language platform used by businesses to sell goods to consumers on the mainland. Many well-known Australian products are sold on Alibaba properties by consumers to other consumers.
Last November, the company's "Singles Day" promotion in China was blamed for creating a severe shortage of Australian baby formula products, including Bellamy's.
Shadow networks of Chinese students and relatives, known as "daigou", were said to be buying up organic baby formula at Australian supermarkets and reselling them at higher prices on Alibaba sites, forcing the likes of Woolworths to implement quotas.
The move also signals Alibaba's intention to expand globally and assuage investor concerns over its international footprint. Alibaba shares are down 15 per cent since the company listed on the New York Stock Exchange in late 2014, underperforming the 5 per cent rise in the broader US market over that period.
Last year the company said it would expand into France, Germany and Italy. It has already established a foothold in the US.
This entry was posted in SUPERSTORES, VIDEO AUDIO, WEALTHY PEOPLE and tagged auctiontreaders.net alibaba superstore, australian alibaba auctiontraders.net superstore, the alibaba superstore auctiontraders.net on April 21, 2016 by Henry.


I learned soon after moving to London from Syria that the pub is central to British life. One of my biggest surprises was to see that people took their children to pubs.
Fish and chips served at The Lamplighter pub in the Lake District. All photos by the author.
My husband and I are sitting at the breakfast table on an exceptionally beautiful morning in the Lake District. He is enjoying a cup of tea, while I drink my coffee as usual. Our host Gareth appears with two vegetarian full English breakfasts, complete with fried eggs, vegetarian sausages, mushrooms, baked beans, hash browns, and tomatoes.
It is our first morning staying near Lake Windermere in the Lake District, the largest national park in England—home of Romantic poet William Wordsworth, children's author Beatrix Potter, as well as countless scenic hiking spots and crystal clear lakes. We chose it as our first destination in a journey to rediscover the UK, the country I am applying to become a citizen of.
A vegetarian full English breakfast. All photos by the author.
I first moved to Britain from Syria to study for my Master's degree and have lived in London for many years, making it my second home. I hope that travelling the country will allow me to experience more of what it means to be British, as well as prepare me for my upcoming "Life in the United Kingdom" test. The multiple-choice assessment is a requirement of anyone applying for citizenship in the UK, and includes questions on British history and culture. I'll be sitting my test two weeks after I arrive back in London from the Lakes.
I learned soon after moving here that the pub is central to British life. I remember during my first week in the UK, one of my biggest surprises was to see people taking their children with them to pubs. I later learned that these establishments weren't just places to drink, they were also about socialising and community.
Heeding Gareth's advice, my husband and I decide to go to The Lamplighter, a family-run pub in Windermere. We order non-alcoholic cocktails and look at the menu. There is a lot of choice: roast beef, veggie burgers, curry, Cumberland sausage and mash, fish of the day. We decide to start with a cheese salad, made with a trio of British cheeses—including a crumbly smoked Lancashire and deliciously pungent soft blue cheese.
Two portions of traditional fish and chips, and a cheese salad, at The Lamplighter pub in the Lake District.
I have a few contradicting thoughts when trying to choose a main course. I want it to be a traditional British dish, but does curry count as a British food? Do I want something vegetarian? Vegetarian and vegan eating is becoming more popular in Britain, but I've had a few failed attempts at going veggie myself—mainly because I miss the meaty dishes I grew up eating in the Middle East. I'd like to order the roast beef, but it's not halal. Also, I think it would be more traditional to have a roast at home on a Sunday. This was introduced to me by my friend Astrid, who loved to host Sunday lunches at her house. My husband and I have adopted this tradition in our home now too—we enjoy having friends over for a roast made with halal meat.
We eventually decide to order fish and chips. A classic pub dish, it also meets the requirements of halal food. The battered cod arrives with a delicate squeeze of lemon juice, hot chips, and fresh garden peas. I think about the study guide I've been reading for the Life in the United Kingdom test, which states that fish and chips and roast beef are considered the traditional foods of England.
Orrest Head Viewpoint in the Lake District.
After lunch, we hike up to the Orrest Head Viewpoint, a summit close to Lake Windermere. We arrive to the top of the hill and see a breathtaking view of the lake and surrounding mountains. It brings back memories of the gorgeous mountains in Syria; hiking trips and picnics with my family back there.
I feel very happy, I feel at home. I know I will always carry inside me fond memories of Syria—it's part of who I am. But I also love my second home that welcomed and accepted me. Becoming a British citizen means I can keep my cultural heritage and adopt aspects of life here too, enjoying freedom, democracy, and cultural diversity.
And, of course, pub meals of fish and chips.


text:
Q: I am trying to overlap a pre tag on top of a textarea, but it's just floating in the middle of its container I have spent some time trying to overlap a pre tag on top of a textarea, I am trying to build a text editor of some sort. However, somehow the pre tag is not being rendered at the top left of its container, it is being rendered in the middle. No margin or padding is pulling it down, so I am out of ideas. There is another strange thing going on, the textarea has position: absolute, but its container is still stretching itself to the textarea's height.
Out of frustration I have copied the exact code from this library: http://satya164.xyz/react-simple-code-editor/. But it still, does not work, even though it is the exact same code.
My Current Code:

const codeEditor = document.getElementById("code-editor__textarea");
const codeRenderer = document.getElementById("code-editor__pre");

codeEditor.addEventListener("keyup", e => {
  codeRenderer.innerHTML = codeEditor.value;
});
*,
:after,
:before {
  box-sizing: inherit;
}

body {
  font-family: monospace;
  line-height: 1.5;
  margin: 0;
}

.code-editor {
  margin: 1.67em 0;
  max-height: 400px;
  overflow: auto;
}

.code-editor__container {
  background-color: #fafafa;
  box-sizing: border-box;
  font-size: 12px;
  font-variant-ligatures: common-ligatures;
  position: relative;
  text-align: left;
  white-space: pre-wrap;
  word-break: keep-all;
}

#code-editor__textarea,
#code-editor__pre {
  -webkit-font-smoothing: antialiased;
  display: inherit;
  font-family: inherit;
  font-size: inherit;
  font-style: inherit;
  font-variant-ligatures: inherit;
  font-weight: inherit;
  letter-spacing: inherit;
  line-height: inherit;
  padding: 10px;
  tab-size: inherit;
  text-indent: inherit;
  text-rendering: inherit;
  text-transform: inherit;
  white-space: inherit;
  word-break: inherit;
}

#code-editor__textarea {
  -webkit-text-fill-color: transparent;
  background: none;
  border: none;
  color: inherit;
  height: 100%;
  left: 0;
  outline: 0;
  overflow: hidden;
  position: absolute;
  resize: none;
  top: 0;
  width: 100%;
}

#code-editor__pre {
  margin: 0;
  pointer-events: none;
  position: relative;
}
<!DOCTYPE html>

  <meta charset="UTF-8" />
  <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  <meta http-equiv="X-UA-Compatible" content="ie=edge" />
  <title>Code Editor</title>

      <textarea id="code-editor__textarea" autocapitalize="off" autocomplete="off" autocorrect="off" spellcheck="false"></textarea>

A: The white-space: pre-wrap; on the container causes this.
You have taken the textarea out of the flow using absolute positioning - but the line breaks before and after it are still there, and because you forced the container to honor them, they push the pre element down accordingly.
(Removing it will make your textarea have a smaller height in turn as well though, because that is set to 100% height of the container. But I guess that would be a desired effect in your case?)

A: Just add following fields to your #code-editor__pre id
  position: absolute;
  top: 0px;
  right: 0px;
  left: 0px;
  bottom: 0px;
  padding: 10px;

const codeEditor = document.getElementById("code-editor__textarea");
const codeRenderer = document.getElementById("code-editor__pre");

codeEditor.addEventListener("keyup", e => {
  codeRenderer.innerHTML = codeEditor.value;
});
*,
:after,
:before {
  box-sizing: inherit;
}

body {
  font-family: monospace;
  line-height: 1.5;
  margin: 0;
}

.code-editor {
  margin: 1.67em 0;
  max-height: 400px;
  overflow: auto;
}

.code-editor__container {
  background-color: #fafafa;
  box-sizing: border-box;
  font-size: 12px;
  font-variant-ligatures: common-ligatures;
  position: relative;
  text-align: left;
  white-space: pre-wrap;
  word-break: keep-all;
}

#code-editor__textarea,
#code-editor__pre {
  -webkit-font-smoothing: antialiased;
  display: inherit;
  font-family: inherit;
  font-size: inherit;
  font-style: inherit;
  font-variant-ligatures: inherit;
  font-weight: inherit;
  letter-spacing: inherit;
  line-height: inherit;
  padding: 10px;
  tab-size: inherit;
  text-indent: inherit;
  text-rendering: inherit;
  text-transform: inherit;
  white-space: inherit;
  word-break: inherit;
}

#code-editor__textarea {
  -webkit-text-fill-color: transparent;
  background: none;
  border: none;
  color: inherit;
  height: 100%;
  left: 0;
  outline: 0;
  overflow: hidden;
  position: absolute;
  resize: none;
  top: 0;
  width: 100%;
}

#code-editor__pre {
  margin: 0;
  pointer-events: none;
  position: absolute;
  top: 0px;
  right: 0px;
  left: 0px;
  bottom: 0px;
  padding: 10px;
}
<!DOCTYPE html>

  <meta charset="UTF-8" />
  <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  <meta http-equiv="X-UA-Compatible" content="ie=edge" />
  <title>Code Editor</title>

      <textarea id="code-editor__textarea" autocapitalize="off" autocomplete="off" autocorrect="off" spellcheck="false"></textarea>


You Have an Evite from the Baileys!
New Age in the new age.
Event: Liveblogging Maidon's first sexual encounter. October 22nd, 9:30 EST.
Hi everyone! Just wanted to send out a quick reminder to all of you "maybes" out there that this weekend is the big day and how much it would mean to Maidon if you could share in this family moment with us. I know how busy all of you are! However, those of you who were lucky enough to co-experience Maidon's natural home birth with us certainly won't want to miss out on her entrance into reproductive maturity. Circle of life!
A lot of people have been asking us why we chose to live blog and simulcast (via Skype for all you international attendees! I'm looking at you, Aunt Denise!) Maidon's first intimate encounter rather than just releasing the traditional Twitter announcement or flock of white doves. Well, on one of the most recent Monday night drum circles, Ken challenged everyone in the family to pioneer ways to improve our SEO practices and drive traffic in the coming year. Someone certainly earned the Medicine Wheel of Facilitated Expression that week!
Those of you who attended Parrish's first birthday party/anti-circumcision demonstration a few years ago will remember how precious these live-streamed shared experiences can be (not to mention the keepsake crocheted foreskin cozies). Who could forget last year's ultra-marathon to beat menopause we launched on Kickstarter? Or Ken's vasectomy gluten-free bake sale? These are treasured moments in our family history that are all the richer for being available online in incredible detail for anyone to see, whether friend, relative, neighbor, colleague or spambot. That's why we add the name of every unique visitor to our blog on the Bailey family quilt. We couldn't do this without you, MarinDad47.
Afterwards there will be a small ceremony as we share the remaining freeze-dried strips of placenta jerky that Migda, our family doula, prepared after Maidon expressed her autonomy in transitioning "out" of my uterus. Please feel free to stay as we compost the remnants of Maidon's hymen and use it to sustain the seedlings in her Garden of Self-Nourishing Womanhood, formerly Ken's heritage chard plot. Commemorative photos and homemade quince jelly will be available for those of you with placental allergies.
Blessings to you all, and don't forget to tweet, retweet, stumble, digg, star, review on Yelp, like, tumble, post, repost, check in, share, upmod and upvote!


If you are planning to buy a puppy, you need to take some time and consider your options, get some puppy buying tips and decide on the best puppy for you.
1. How Much Spare Time Do I Have for the Puppy?
The amount of spare time you have for a pet is essential when deciding on a puppy breed. Some breeds can do well if left by themselves, while others will develop unwanted behavior such as chewing and barking. A dog needs to be taken out for walks and you need to play with him, otherwise he will get obese and frustrated. Opt for a low energy dog if you are a busy person.
2. How Big Is My Space?
Typically, large dog breeds need a lot of space and a yard to be able to spend their energy. Smaller dog breeds may be more suitable for apartment life. Low and medium energy dogs can be suitable for smaller spaces, while high energy dogs will be unhappy in an apartment.
3. Is the Puppy Suitable for My Family?
You need to ask yourself whether the puppy will be suitable for your family, especially if you have children. There are certain breeds that are more suitable for families with children.
Every dog has his own personality; however, you need to consider if the puppy breed's typical behavior will be suitable for your household. If you are an active family, you need an active dog. If you are sedentary, you should opt for a low energy dog.
4. How Much Will the Puppy Cost?
You may even opt for dog sitters or professional grooming, which may be pricey. Think about your budget and how much you can afford to spend on your dog on a monthly basis.
5. How Much Grooming Does the Puppy Need?
Dogs need grooming on a regular basis, regardless of their coat length. Long, curly and wiry haired dogs need more grooming.
6. Why Are You Buying the Dog?
Do you need a companion, a play mate or a guard dog? Establishing the purpose of the dog should give you a clear answer about the type of breed you are looking for.
7. Do You Have Experience with Dogs?
As a first time owner, you cannot just buy any dog you want. Certain breeds are more suitable for first time owners, while others need an experienced owner.
8. Where to Buy a Puppy?
You may buy a puppy from a reputable breeder. You may also opt for adoption. Visit a few shelters, where you may find all sorts of dogs. Bear in mind that cross breeds are intelligent dogs and are as good as any pure breed. Ask about the dog's history and temperament.


Webpages, illustrations and animations have been designed and developed by Sigurd Erik Hoelsbrekken, currently working at the department of orthopedic surgery, Kongsvinger Hospital. The purpose of the pages is to provide information to former and present participants in the relevant clinical trials, the webpages have no commercial incentives and have been made without commercial sponsorship. Please use the reply form found below to send requests or comments. For medical questions, please use the personal contact information provided upon consent.


Since 1977, the people of the United States have enjoyed the powerful legal protections which are provided for in the Fair Debt Collection Practices Act (FDCPA). The U.S. Congress enacted this law with the purpose of safeguarding the public against a number of different harassing and abusive tactics which are common among creditors and debt collection agencies engaged in pursuing payment for bad debt. Not only does the FDCPA prohibit a long list of unscrupulous debt collection practices, but it also provides the victim of creditor harassment – you – with legal recourse so that you can obtain justice and even monetary damages.
The FDCPA list of prohibited behaviors includes attempts to shame you into paying, such as by discussing the debt with your coworkers or neighbors, publishing your name on a list of bad debts, or contacting you with "embarrassing media" such as a postcard with details about the debt. It also includes attempts at coercion or intimidation like making false threats of arrest or legal action, or using profanity and abusive language. It even includes plain and simple harassment such as making the phone ring off the hook or calling you before 8:00 in the morning or after 9:00 in the evening.
Another feature of the FDCPA is that as soon as you inform your creditors or debt collectors of the fact that you have hired an Ocala bankruptcy attorney to represent you in debt settlement or bankruptcy, they can no longer continue to contact you. Instead, they will have to direct any inquiries to us at The Law Offices of Justin McMurray, P.A. If you believe that you have been subjected to a violation of any of the terms of the Fair Debt Collection Practices Act, contact us for a free consultation to discuss your experiences and learn whether you have grounds to sue. You could stand to receive at least $1,000 in monetary damages plus attorney's fees, making it possible for you to obtain compensation and the justice you deserve.


text:
Sokolova Retires Again, Becomes Dynamo Krasnoda's General Manager
Dynamo Krasnodar and Lyubov Sokolova have recently called a press meeting to announce her retirement and subsequent move to the team's front office. Here is her official statement:
"I decided to finally finish my sports career. Looking back, I can say that I am completely happy with the part of my life that I spent in volleyball. And I'm not going to leave this wonderful sport. Starting July, I will serve as Dynamo Krasnodar's general manager. I like this club and I like Krasnodar. I do not regret that I moved here from Moscow. I hope that my success in this new business will be no less weighty than those that I achieved when playing volleyball. At least, I will make every effort for it to be so."
Widely considered by many experts to be one of the best players to ever play the sport, this is Sokolova's second retirement. She first retired prior to the 2016 Olympic Games, after winning the 2006 and 2010 World Championships and 2000 and 2004 Olympic silver with Russia's national team. She shocked fans last season when at 40-year-old she announced her return to volleyball, signing a contract with her beloved Krasnodar, who was undergoing a deep financial crisis, in order to help it fend off relegation. At the end of the season, she was even called up for Russia's national team again, to which she refused.
FIVB Men's Challenger Cup: Portugal Wins Pool A; Cuba Also Clinches Semis Bid
Italy's Top Scorer Paola Egonu Rejoins Team for Week 3 of VNL

redpajama_set_name: RedPajamaCommonCrawl


text:
Michigan basketball reverses fortune, finishes strong in OT vs. UCLA, 78-69
Michigan erased a 15-point second-half deficit during a 78-69 overtime win over UCLA on Saturday in Ann Arbor.
Michigan basketball reverses fortune, finishes strong in OT vs. UCLA, 78-69 Michigan erased a 15-point second-half deficit during a 78-69 overtime win over UCLA on Saturday in Ann Arbor. Check out this story on Freep.com: http://on.freep.com/2B38Zeh
Nick Baumgardner, Detroit Free Press Published 6:13 p.m. ET Dec. 9, 2017 | Updated 6:26 p.m. ET Dec. 9, 2017
Michigan coach John Beilein discusses his team's 15-point comeback win over UCLA, 78-69, in overtime at Crisler Center on Saturday, Dec. 9, 2017. Nick Baumgardner, Detroit Free Press
Michigan's Zavier Simpson (3) and Isaiah Livers try to block a shot from UCLA's Prince Ali during the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017.(Photo: Junfu Han, Detroit Free Press)
Earlier this week, Michigan's second half was a disaster.
And for about five minutes Saturday in Ann Arbor, history was repeating itself.
The Wolverines found themselves down 15 with 14:48 to play against UCLA. But unlike Monday's loss at Ohio State, Michigan turned things around and finished with style on its way to a 78-69 overtime win over the Bruins at the Crisler Center.
"We did everything we could to play some inefficient basketball," Michigan coach John Beilein said after the game. "But when we really needed to suck it up and get work done at the end, we got it done.
"I'm hoping that's a huge bench mark for our team as we go forward. It was the exact opposite of what happened at Ohio State. ... It was a great win for us."
More: Ole Miss QB Shea Patterson, teammates visit snowy Big House
Photos: Michigan 78, UCLA 69 (OT)
Michigan's Jordan Poole (2) and Moe Wagner cheer for teammates during the second half against UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Charles Matthews is defended by UCLA's Kris Wilkes during the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Two basketball fans, dressed as Chewbacca from Star Wars, dance during the second half of Michigan's 78-69 OT win over UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Charles Matthews shoots against UCLA's Kris Wilkes in the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Moe Wagner celebrates scoring against UCLA in the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Eli Brooks (55) makes a layup against UCLA in the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Jordan Poole, left, celebrates with Charles Matthews during a timeout in overtime of the Wolverines' 78-69 win against UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Tony Ding, AP
Dec 9, 2017; Ann Arbor, MI, USA; Michigan's Charles Matthews celebrates a 3-point basket in overtime of the Wolverines' 78-69 win against UCLA at Crisler Center. Rick Osentoski, USA TODAY Sports
Michigan's Zavier Simpson (3) and Isaiah Livers try to block a shot from UCLA's Prince Ali during the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Zavier Simpson makes a layup against UCLA in the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Moe Wagner (13) and Muhammad-Ali Abdur-Rahkman defend UCLA's Aaron Holiday during the first half of the Wolverines' 78-69 win at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan forward Moritz Wagner shoots against UCLA's Thomas Welsh during the overtime of the Wolverines' 78-69 win at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan's Charles Matthews shoots a 3-point shot during overtime of the Wolverines' 78-69 win over UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
UCLA head coach Steve Alford reacts to a play during the first half against Michigan at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan players huddle before a free throw during the first half against UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan coach John Beilein reacts to a play during the second half of the Wolverines' 78-69 win in OT against UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan forward Moe Wagner and UCLA forward Alex Olesinski battle for a loose ball during the first half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
Michigan coach John Beilein talks to guard Jordan Poole during the first half against UCLA at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Junfu Han, Detroit Free Press
UCLA guard Aaron Holiday attempts a basket, defended by Michigan's Moe Wagner, top, and Charles Matthews in the second half at Crisler Center in Ann Arbor, Saturday, Dec. 9, 2017. Tony Ding, AP
Beilein went on to say he "felt almost guilty" after the victory Saturday because of all the miscues his club went through: The Wolverines were a miserable 8 of 22 from the foul line and their brutal first five minutes of the second half was nearly enough to bury the team.
But, behind 23 points from Moritz Wagner and 20 points, 8 rebounds and 3 assists from Charles Matthews, Michigan (8-3, 1-1) found a way to finish things off.
The Wolverines return to the floor Tuesday (9 p.m., ESPN 2) at Texas.
"We'll take the 'W' every day," Beilein said. "We did earn it in the long run."
Matthews' day
It was an up and down day for Matthews, but perhaps his biggest learning experience to date as a Michigan player. Early in the second half, with the team languishing, Beilein looked at his talented third-year sophomore and told him he'd been UCLA's most valuable player all day.
"He needed to be the most valuable player for Michigan," Beilein added.
And while it wasn't always easy, Matthews did respond. He scored 14 of his 20 points in the second half and overtime, had a personal 8-0 run in the second half and made enough clutch plays for his team with the game on the line.
He still went just 2 of 10 from the foul line and is now a woeful 47.7 percent on the season.
"I just felt like I kind of lost the last game for us, because I wasn't bringing a lot of energy," Matthews said. "I can't let my teammates down again. This team looks at me (for energy). So I thought 'I need to do what I need to do.' "
Beilein says Matthews is still in the process of learning to play and excel within the structure of Michigan's offense. But he also wants him to keep his own identity and understand when it's time to break off and get a basket.
On Saturday, it was just enough.
Simpson shines
Michigan sophomore point guard Zavier Simpson came off the bench once again Saturday, but he made the most of his minutes and turned in what was probably his best game of the year.
Simpson finished with 15 points, 4 steals and 2 boards for the Wolverines in 24 minutes. He, like freshman Eli Brooks and grad transfer Jaaron Simmons, has been up and down at the point this year.
But he hung in long enough Saturday. Asked what Beilein told him before leaving him on the floor for an extended stretch in the second half, Simpson's answer was simple.
"Just play defense," he said.
Simpson stripped UCLA star Aaron Holiday near midcourt with less than 30 seconds to go in regulation and converted a critical layup to bring the Wolverines back within one and extend the game.
He and Duncan Robinson made eight of the team's 12 steals. UCLA finished with 20 turnovers.
Line struggles
Michigan's foul shooting was horrific Saturday, as the Wolverines went 1 of 4 in the first half, 6 of 14 in the second and 1 of 4 in the overtime period.
As a team, Michigan is now shooting 62.7 percent from the charity stripe this season. Matthews was 2 of 10 from the line, Wagner was 0 of 3. Simpson and Jordan Poole both missed free throws.
But Brooks — who had not made two straight the entire year — managed to step to the line and drill two critical shots with 10 seconds left, sending the game into overtime.
Michigan guard Jordan Poole, left, celebrates with guard Charles Matthews in OT. (Photo: The Associated Press)
Minute moves
Beilein wanted to get more time for both Poole and fellow freshman Isaiah Livers on Saturday, though it ended up not being by much.
Poole logged 11 minutes, up from Monday's eight, and was an ineffective 0 of 3 from the field (all 3-pointers) and just 1 of 2 from the free throw line. He had one rebound and a turnover.
Livers, meanwhile, got the most out of his 11 minutes as he pullled down a team-high seven rebounds and also added an assist as the Wolverines' backup four-man.
Muhammad-Ali Abdur-Rahkman played 44 of a possible 45 minutes Saturday.
Robinson's woes
Senior captain Duncan Robinson is in a funk. The fifth-year senior sharpshooter was just 1 of 7 from the field, 0 of 5 from long range, for 2 points and 2 rebounds in 34 minutes of action Saturday.
He's just 5 of 30 from the floor in his last four games, 4 of 24 from long range.
He's still in the starting lineup, though Livers is starting to cut into his minutes. Robinson logged 29 minutes of regulation time Saturday, but did play the entire overtime session.
Beilein said after the game he was confident Robinson would shoot his way out of his slump.
Contact Nick Baumgardner: nbaumgardn@freepress.com. Follow him on Twitter @NickBaumgardner.
Download our Wolverines Xtra app for free on Apple and Android devices!


text:
Things You Need to Know About The Dating Scene in Greece
Women may become near their slaves to compensate for his or her segregation from public affairs and from social gatherings with male visitors in their own home. The only public area in which women had been allowed to participate was faith, and slave women had been allowed to take part in some non secular affairs. At least as early as the 600s BCE, societies across the Black Sea bought slaves to Greek traders in change for luxurious goods corresponding to wine and clothes.
Plato mentions one of these because the obligation incumbent upon each particular person to provide for a continuance of representatives to succeed himself as ministers of the Divinity (toi Theoi hyperetas an' hautou paradidonai). With this in mind, childless individuals would sometimes undertake unwanted youngsters, including youngsters who had been left to die. For a marriage to be viewed as reliable in Athens, both the bride and groom had to be of free status, and after 451BCE, each had to be legitimate children of Athenian citizen households.
These girls would be married as young as 12 in order to produce an heir as quickly as potential. They could possibly be claimed first by paternal uncles, and if there was no uncles to make the declare, then paternal cousins by order of age would have the subsequent right to marry her. If nonetheless nobody was in a position to claim her, she was free to marry who she pleased "of the tribe from those that apply". However, if she have been to turn down the first claimant, she would owe him half of her inheritance. Independent of any public concerns, there were additionally personal or private causes (explicit to the ancients) which made marriage an obligation.
Things you should now about Greek girls
Here is an overview of the struggles women have needed to face in Modern Greece and the way they've overcome them. Elites across Greece have been inclined to gauge poor common folk as innately servile, which mitigated disdain they may have for parents selling their children into slavery. But Herodotus, according to Nell Painter, scolded the Thracians for selling their children for export. In Gortyn both husband or wife had the ability to divorce the other. When initiated by the husband he owed his wife a small monetary compensation.
This was only permitted if the spouse had not borne her husband a baby. Finally, if a girl grew to become epikleros after her marriage, her closest male family member on her father's demise was anticipated to end each his and her present marriage in order to marry her. In Athens, in the case of a father dying intestate and with out male children, his heiress had no alternative in marriage. The woman was not an heiress by modern-day Western standards, as she couldn't really personal the land, nevertheless, she could not be separated from it. This meant that any man must first marry her so as to personal the land.
Do Greek girls use relationship sites and apps?
The amount of occasions I've wound my Gran up by telling her that the Greeks did not create the English language, or Western civilisation or that the Olympics had been invented by one other nation. If you've simply turned, in English terms, 35, the Greeks will say you're 36.
It's a big factor, since it's basically a prelude to marriage. This is a form of analysis of you as a future husband of their lovely daughter, so be prepared. As we've said, they are quite keen about this craft, so if she starts cooking all of the delicious dishes for you, with all of the love and care, then she is quite interested in you as a future husband. Now that we all know the widespread Greek women features and their character traits, let's talk about their culture.
A wealthy personal citizen would possibly lease slaves to work in a mine or quarry. Athens, in accordance with Nell Irvin Painter, employed between 300 and 1,000 Scythian slaves as policemen. It is reported that in Greece revenue seekers would scoop up and sell infants that oldsters had left exposed to die. And there have been those who had been born into slavery – the children of slaves and regarded the property of the slave grasp. Female slaves had been prohibited from keeping their kids, and infants born of grasp-servant liaison may be destroyed.
In cases the place a woman was found to have dedicated adultery, the husband was obliged to divorce his spouse beneath threat of disenfranchisement. It has been suggested that in some instances, to be able to keep away from scandal, husbands may not have strictly followed this regulation, nonetheless. Upon divorce, a husband was required to pay back his wife's dowry. If he did not, he was liable to pay 18% curiosity annually on it.
Best compliments to Greek women
Today I will attempt to inform you all that I find out about Greek girls, about their customs, tradition, how to meet them, how to date them and, lastly, tips on how to marry them. You don't even have to think about a approach to begin conversation with a Greek girl. You can talk with your date for hours about nearly every thing. Many famous philosophers come from historic Greece in order that they've in all probability inherited this from them.
Though the inhabitants in Greece is break up evenly between women and men, women solely make up around 30% of the work force, based on data compiled by Unicef. The rural areas of Greece are largely responsible for this lopsided statistic because, for essentially the most half, women adhere to their traditional, home roles. Though there are several well-known women who've made an impact in Greece's history, it's usually men who are sometimes celebrated. Women have been traditionally valued for their capacity to bear and lift kids and care for their houses and households. Outside the home, nevertheless, women have struggled to obtain their rights and freedoms.
However, women and men sat at different tables, the women would sit and wait till the lads were carried out. The most important ritual of the wedding day was the anakalupteria, which was the removal of the bride's veil.
If you end up in a bar, you will see that Greek men will more spontaneously come and speak to a foreigner than they would with a Greek woman. The courtship that ensues is often full marry a greek woman of compliments and praises about your accent, beauty or even your homeland. Greek men love to be in charge so they can provide and deal with their families.
Wintertime marriages have been popular because of the significance of that point to Hera, the goddess of marriage. The couple participated in a ceremony which included rituals corresponding to veil removal, but it was the couple living collectively that made the marriage authorized. Marriage was understood to be the official transition from childhood into adulthood for females.


Defendants in class actions typically demand copies of plaintiffs' engagement letters under the theory that they might reveal a conflict of interest that undermines plaintiffs' ability to represent the class and thus plaintiffs' ability to satisfy the "adequacy" of representation requirement of Federal Rule of Civil Procedure 23(a)(4).
For their part, plaintiffs typically object to producing their engagement letters on the view that they are protected by the attorney-client privilege and attorney work product doctrine. Class counsel should be mindful, however, not to overlook relevance as an additional reason for resisting the production of engagement letters.
Aside from being privileged, engagement letters are generally not relevant under Rule 26. See In re: Takata Airbag Prod. Liab. Litig., No. 15-2599, 2016 WL 5844309, at *5 (S.D. Fla. May 23, 2016); In Re Riddell Concussion Reduction Litig., No. CV 13-7585 (JBS/JS), 2016 WL 7325512, at *2 (D.N.J. Jan. 19, 2016); Lee-Bolton v. Koppers Inc., No. l:10-CV-253-MCR-GRJ, 2015 WL 11110545, at *1 (N.D. Fla. June 10, 2015); In re Google AdWords Litigation, 2010 WL 4942516, at *4-5 (N.D. Cal. Nov. 12, 2010); Stanich v. Travelers Indem. Co., 259 F.R.D. 294, 322 (N.D. Ohio 2009); Piazza v. First America Title Insurance Co., No. 3:06CV756, 2007 WL 4287469, at *1 (D. Conn. Dec. 5, 2007); Mitchell-Tracey v. United Gen. Title Ins. Co., No. CIV. AMD-05-1428, 2006 WL 149105, at *2-3 (D. Md. Jan. 9, 2006); see also Newberg on Class Actions § 22:79 (4th ed.) ("Defendants often request discovery regarding fee arrangements between the plaintiffs and their counsel, but courts usually find such discovery to be irrelevant to the issue of certification.") (collecting cases); Federal Judicial Center, Manual for Complex Litigation § 21.141 (4th ed.) ("Precertification inquiries into the named parties' finances or the financial arrangements between the class representatives and their counsel are rarely appropriate[.]").
Class counsel should insist that defendants come forward with some non-speculative reason to believe a conflict of interest exists that undermines adequacy and warrants the production of otherwise privileged materials. Absent such a showing, engagement letters are viewed by many courts as an improper "fishing expedition" and outside the scope of Rule 26 and not an appropriate discovery target. See Robin v. Doctors Officenters Corp., No. 84 C 10798, 1988 WL 74321, at *2 (N.D. Ill. July 11, 1988) ("[U]nless defendants have information that may seriously undermine a plaintiffs standing or create a conflict of interest, they may not engage in a broad 'fishing expedition' to turn up such facts."); see also Fort Worth Employees' Ret. Fund v. J.P. Morgan Chase & Co., No. 09 CIV. 3701 JPO JCF, 2013 WL 1896934, at *2 (S.D.N.Y. May 7, 2013) (denying motion to compel discovery concerning "the arrangement between the lead plaintiffs and their lawyers may be relevant to the fitness of lead plaintiffs or their counsel to represent the class" because defendant had "provided no non-speculative basis for raising such concerns" and because "the defendants [would] have the opportunity to question the lead plaintiffs at deposition on their adequacy to represent the class without the necessity of disclosure of the retainer and monitoring agreements.").
To be sure, documents and information concerning potential conflicts of interest between class representatives and absent class members are and should be discoverable. It is a mistake, though to take for granted that engagement letters are categorically relevant to that inquiry.