title: Data-driven Competitive Algorithms for Online Knapsack and Set Cover

abstract: The design of online algorithms has tended to focus on algorithms with worst-case guarantees, e.g., bounds on the competitive ratio. However, it is well-known that such algorithms are often overly pessimistic, performing sub-optimally on non-worst-case inputs. In this paper, we develop an approach for data-driven design of online algorithms that maintain near-optimal worst-case guarantees while also performing learning in order to perform well for typical inputs. Our approach is to identify policy classes that admit global worst-case guarantees, and then perform learning using historical data within the policy classes. We demonstrate the approach in the context of two classical problems, online knapsack and online set cover, proving competitive bounds for rich policy classes in each case. Additionally, we illustrate the practical implications via a case study on electric vehicle charging.


title: Kineverse: A Symbolic Articulation Model Framework for Model-Agnostic Mobile Manipulation

abstract: Service robots in the future need to execute abstract instructions such as "fetch the milk from the fridge". To translate such instructions into actionable plans, robots require in-depth background knowledge. With regards to interactions with doors and drawers, robots require articulation models that they can use for state estimation and motion planning. Existing frameworks model articulated connections as abstract concepts such as prismatic, or revolute, but do not provide a parameterized model of these connections for computation. In this paper, we introduce a novel framework that uses symbolic mathematical expressions to model articulated structures -- robots and objects alike -- in a unified and extensible manner. We provide a theoretical description of this framework, and the operations that are supported by its models, and introduce an architecture to exchange our models in robotic applications, making them as flexible as any other environmental observation. To demonstrate the utility of our approach, we employ our practical implementation Kineverse for solving common robotics tasks from state estimation and mobile manipulation, and use it further in real-world mobile robot manipulation.


title: Revisiting the Integrated Star Formation Law. II. Starbursts and the Combined Global Schmidt Law

abstract: We compile observations of molecular gas contents and infrared-based star formation rates (SFRs) for 112 circumnuclear star forming regions, in order to re-investigate the form of the disk-averaged Schmidt surface density star formation law in starbursts. We then combine these results with total gas and SFR surface densities for 153 nearby non-starbursting disk galaxies from de los Reyes \& Kennicutt (2019), to investigate the properties of the combined star formation law, following Kennicutt (1998; K98). We confirm that the combined Schmidt law can be fitted with a single power law with slope $n = 1.5\pm0.05$ (including fitting method uncertainties), somewhat steeper than the value $n = 1.4\pm0.15$ found by K98. Fitting separate power laws to the non-starbursting and starburst galaxies, however, produces very different slopes ($n = 1.34\pm0.07$ and $0.98\pm0.07$, respectively), with a pronounced offset in the zeropoint ($\sim$0.6\,dex) of the starburst relation to higher SFR surface densities. This offset is seen even when a common conversion factor between CO intensity and molecular hydrogen surface density is applied, and is confirmed when disk surface densities of interstellar dust are used as proxies for gas measurements. Tests for possible systematic biases in the starburst data fail to uncover any spurious sources for such a large offset. We tentatively conclude that the global Schmidt law in galaxies, at least as it is conventionally measured, is bimodal or possibly multi-modal. Possible causes may include changes in the small-scale structure of the molecular ISM or the stellar initial mass function. A single $n \sim 1.5$ power law still remains as a credible approximation or "recipe" for analytical or numerical models of galaxy formation and evolution.


title: Numerical bifurcation analysis of renewal equations via pseudospectral approximation

abstract: We propose an approximation of nonlinear renewal equations by means of ordinary differential equations. We consider the integrated state, which is absolutely continuous and satisfies a delay differential equation. By applying the pseudospectral approach to the abstract formulation of the differential equation, we obtain an approximating system of ordinary differential equations. We present convergence proofs for equilibria and the associated characteristic roots, and we use some models from ecology and epidemiology to illustrate the benefits of the approach to perform numerical bifurcation analyses of equilibria and periodic solutions. The numerical simulations show that the implementation of the new approximating system is ten times more efficient than the one originally proposed in [Breda et al, SIAM Journal on Applied Dynamical Systems, 2016], as it avoids the numerical inversion of an algebraic equation.


title: Matrix Multiplication and Binary Space Partitioning Trees : An Exploration

abstract: Herein we explore a dual tree algorithm for matrix multiplication of $A\in \mathbb{R}^{M\times D}$ and $B\in\mathbb{R}^{D\times N}$, very narrowly effective if the normalized rows of $A$ and columns of $B$, treated as vectors in $\mathbb{R}^{D}$, fall into clusters of order proportionate to $\Omega(D^{\tau})$ with radii less than $\arcsin(\epsilon/\sqrt{2})$ on the surface of the unit $D$-ball. The algorithm leverages a pruning rule necessary to guarantee $\epsilon$ precision proportionate to vector magnitude products in the resultant matrix. \textit{ Unfortunately, if the rows and columns are uniformly distributed on the surface of the unit $D$-ball, then the expected points per required cluster approaches zero exponentially fast in $D$; thus, the approach requires a great deal of work to pass muster.}


title: Assimilation of the SCATSAR-SWI with SURFEX: Impact of local observation errors in Austria

abstract: The proper determination of soil moisture on different scales is important for applications in a variety of fields. We aim to develop a high-level soil moisture product with high temporal and spatial resolution by assimilating the multilayer soil moisture product SCATSAR-SWI (Scatterometer Synthetic Aperture Radar Soil Water Index) into the surface model SURFEX. In addition, we probe the impact of the findings on the Numerical Weather Prediction (NWP) in Austria. The data assimilation system consists of the NWP model AROME and the SURFEX Offline Data Assimilation, which provide atmospheric forcing and soil moisture fields as mutual input. To address the known sensitivity of the employed simplified Extended Kalman Filter to the specification of errors, we compute the observation error variances of the SCATSAR-SWI locally using Triple Collocation Analysis and implement them into the assimilation system. The verification of the forecasted 2 m temperature and relative humidity against measurements of Austrian weather stations shows that the actual impact of the local error approach on the atmospheric forecast is slightly positive to neutral compared to the standard error approach, depending on the time of the year. The direct verification of the soil moisture analysis against a gridded water balance product reveals a degradation of the unbiased root mean square error for small observation errors.


title: Generation of global vegetation products from EUMETSAT AVHRR/METOP satellites

abstract: We describe the methodology applied for the retrieval of global LAI, FAPAR and FVC from Advanced Very High Resolution Radiometer (AVHRR) onboard the Meteorological-Operational (MetOp) polar orbiting satellites also known as EUMETSAT Polar System (EPS). A novel approach has been developed for the joint retrieval of three parameters (LAI, FVC, and FAPAR) instead of training one model per parameter. The method relies on multi-output Gaussian Processes Regression (GPR) trained over PROSAIL EPS simulations. A sensitivity analysis is performed to assess several sources of uncertainties in retrievals and maximize the positive impact of modeling the noise in training simulations. We describe the main features of the operational processing chain along with the current status of the global EPS vegetation products, including details about its overall quality and preliminary assessment of the products based on intercomparison with equivalent (MODIS, PROBA-V) satellite vegetation products.


title: Action potential propagation and block in a model of atrial tissue with myocyte-fibroblast coupling

abstract: The electrical coupling between myocytes and fibroblasts and the spacial distribution of fibroblasts within myocardial tissues are significant factors in triggering and sustaining cardiac arrhythmias but their roles are poorly understood. This article describes both direct numerical simulations and an asymptotic theory of propagation and block of electrical excitation in a model of atrial tissue with myocyte-fibroblast coupling. In particular, three idealised fibroblast distributions are introduced: uniform distribution, fibroblast barrier and myocyte strait, all believed to be constituent blocks of realistic fibroblast distributions. Primary action potential biomarkers including conduction velocity, peak potential and triangulation index are estimated from direct simulations in all cases. Propagation block is found to occur at certain critical values of the parameters defining each idealised fibroblast distribution and these critical values are accurately determined. An asymptotic theory proposed earlier is extended and applied to the case of a uniform fibroblast distribution. Biomarker values are obtained from hybrid analytical-numerical solutions of coupled fast-time and slow-time periodic boundary value problems and compare well to direct numerical simulations. The boundary of absolute refractoriness is determined solely by the fast-time problem and is found to depend on the values of the myocyte potential and on the slow inactivation variable of the sodium current ahead of the propagating pulse. In turn, these quantities are estimated from the slow-time problem using a regular perturbation expansion to find the steady state of the coupled myocyte-fibroblast kinetics. The asymptotic theory gives a simple analytical expression that captures with remarkable accuracy the block of propagation in the presence of fibroblasts.


title: Semantic Communications for Speech Signals

abstract: We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which minimizes the error at the semantic level rather than the bit level or symbol level as in the traditional communication systems. Particularly, based on an attention mechanism employing squeeze-and-excitation (SE) networks, we design the transceiver as an end-to-end (E2E) system, which learns and extracts the essential speech information. Furthermore, in order to facilitate the proposed DeepSC-S to work well on dynamic practical communication scenarios, we find a model yielding good performance when coping with various channel environments without retraining process. The simulation results demonstrate that our proposed DeepSC-S is more robust to channel variations and outperforms the traditional communication systems, especially in the low signal-to-noise (SNR) regime.


title: Algorithmic Risk Assessments Can Alter Human Decision-Making Processes in High-Stakes Government Contexts

abstract: Governments are increasingly turning to algorithmic risk assessments when making important decisions, such as whether to release criminal defendants before trial. Policymakers assert that providing public servants with algorithmic advice will improve human risk predictions and thereby lead to better (e.g., fairer) decisions. Yet because many policy decisions require balancing risk-reduction with competing goals, improving the accuracy of predictions may not necessarily improve the quality of decisions. If risk assessments make people more attentive to reducing risk at the expense of other values, these algorithms would diminish the implementation of public policy even as they lead to more accurate predictions. Through an experiment with 2,140 lay participants simulating two high-stakes government contexts, we provide the first direct evidence that risk assessments can systematically alter how people factor risk into their decisions. These shifts counteracted the potential benefits of improved prediction accuracy. In the pretrial setting of our experiment, the risk assessment made participants more sensitive to increases in perceived risk; this shift increased the racial disparity in pretrial detention by 1.9%. In the government loans setting of our experiment, the risk assessment made participants more risk-averse; this shift reduced government aid by 8.3%. These results demonstrate the potential limits and harms of attempts to improve public policy by incorporating predictive algorithms into multifaceted policy decisions. If these observed behaviors occur in practice, presenting risk assessments to public servants would generate unexpected and unjust shifts in public policy without being subject to democratic deliberation or oversight.


title: Wavelets on Intervals Derived from Arbitrary Compactly Supported Biorthogonal Multiwavelets

abstract: (Bi)orthogonal (multi)wavelets on the real line have been extensively studied and employed in applications with success. A lot of problems in applications are defined on bounded intervals or domains. Therefore, it is important in both theory and application to construct all possible wavelets on intervals with some desired properties from (bi)orthogonal (multi)wavelets on the real line. Vanishing moments of compactly supported wavelets are the key property for sparse wavelet representations and are closely linked to polynomial reproduction of their underlying refinable (vector) functions. Boundary wavelets with low order vanishing moments often lead to undesired boundary artifacts as well as reduced sparsity and approximation orders near boundaries in applications. From any arbitrarily given compactly supported (bi)orthogonal multiwavelet on the real line, in this paper we propose two different approaches to construct/derive all possible locally supported (bi)orthogonal (multi)wavelets on $[0,\infty)$ or $[0,1]$ with or without prescribed vanishing moments, polynomial reproduction, and/or homogeneous boundary conditions. The first approach generalizes the classical approach from scalar wavelets to multiwavelets, while the second approach is direct without explicitly involving any dual refinable functions and dual multiwavelets. (Multi)wavelets on intervals satisfying homogeneous boundary conditions will also be addressed. Though constructing orthogonal (multi)wavelets on intervals is much easier than their biorthogonal counterparts, we show that some boundary orthogonal wavelets cannot have any vanishing moments if these orthogonal (multi)wavelets on intervals satisfy the homogeneous Dirichlet boundary condition. Several examples of orthogonal and biorthogonal multiwavelets on the interval $[0,1]$ will be provided to illustrate our construction approaches and proposed algorithms.


title: On the spectral sets of Inoue surfaces

abstract: The Inoue surfaces are certain non-Kaehler complex surfaces that have the structure of a $T^3$ bundle over the circle. We study the Inoue surfaces $S_M$ with the Tricerri metric and the canonical spin$^c$ structure, and the corresponding chiral Dirac operators twisted by a flat $\mathbb C^*$--connection. The twisting connection is determined by $z \in \mathbb C^*$, and the points for which the twisted Dirac operators $\mathcal D^{\pm}_z$ are not invertible are called spectral points. We show that there are no spectral points inside the annulus $\alpha^{-1/4} < |z| < \alpha^{1/4}$, where $\alpha >1$ is the only real eigenvalue of the matrix $M$ that determines $S_M$, and find the spectral points on its boundary. Via Taubes' theory of end-periodic operators, this implies that the corresponding Dirac operators are Fredholm on any end-periodic manifold whose end is modeled on $S_M$.


title: Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online

abstract: One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions. In this paper, we present a digital biomarker for PD that utilizes the study of micro-expressions. We analyzed the facial action units (AU) from 1812 videos of 604 individuals (61 with PD and 543 without PD, mean age 63.9 yo, sd 7.8 ) collected online using a web-based tool (www.parktest.net). In these videos, participants were asked to make three facial expressions (a smiling, disgusted, and surprised face) followed by a neutral face. Using techniques from computer vision and machine learning, we objectively measured the variance of the facial muscle movements and used it to distinguish between individuals with and without PD. The prediction accuracy using the facial micro-expressions was comparable to those methodologies that utilize motor symptoms. Logistic regression analysis revealed that participants with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals. An automated classifier using Support Vector Machine was trained on the variances and achieved 95.6% accuracy. Using facial expressions as a biomarker for PD could be potentially transformative for patients in need of physical separation (e.g., due to COVID) or are immobile.


title: The blow-up rate for a non-scaling invariant semilinear wave equations in higher dimensions

abstract: We consider the semilinear wave equation $$\partial_t^2 u -\Delta u =f(u), \quad (x,t)\in \mathbb R^N\times [0,T),\qquad (1)$$ with $f(u)=|u|^{p-1}u\log^a (2+u^2)$, where $p>1$ and $a\in \mathbb R$, with subconformal power nonlinearity. We will show that the blow-up rate of any singular solution of (1) is given by the ODE solution associated with $(1)$, The result in one space dimension, has been proved in \cite{HZjmaa2020}. Our goal here is to extend this result to higher dimensions.


title: Two-photon absorption of time-frequency-entangled photon pairs by molecules: the roles of photon-number correlations and spectral correlations

abstract: While two-photon absorption (TPA) and other forms of nonlinear interactions of molecules with isolated time-frequency-entangled photon pairs (EPP) have been predicted to display a variety of fascinating effects, their potential use in practical quantum-enhanced molecular spectroscopy requires close examination. This paper presents a detailed theoretical study of quantum-enhanced TPA by both photon-number correlations and spectral correlations, including an account of the deleterious effects of dispersion. While such correlations in EPP created by spontaneous parametric down conversion can increase the TPA rate significantly in the regime of extremely low optical flux, we find that for typical molecules in solution this regime corresponds to such low TPA event rates as to be unobservable in practice. Our results support the usefulness of EPP spectroscopy in atomic or other narrow-linewidth systems, while questioning the efficacy of such approaches for broadband systems including molecules in solution.


title: Dyadic bi-parameter simple commutator and dyadic little BMO

abstract: Let $\bfT$ is a certain tensor product of simple dyadic shifts defined below. We prove here that for dyadic bi-parameter commutator the following equivalence holds $ \|\bfT b-b \bfT \| \asymp \|b\|_{bmo^d}$. This result is well-known for many types of bi-parameter commutators, see \cite{FS}, \cite{DLWY} and \cite{DPSK} for more details.


title: Pump efficacy in a fluid-structure interaction model of a chain of contracting lymphangions

abstract: The transport of lymph through the lymphatic vasculature is the mechanism for returning excess interstitial fluid to the circulatory system, and it is essential for fluid homeostasis. Collecting lymphatic vessels comprise a significant portion of the lymphatic vasculature and are divided by valves into contractile segments known as lymphangions. Despite its importance, lymphatic transport in collecting vessels is not well understood. We present a computational model to study lymph flow through chains of valved, contracting lymphangions. We used the Navier-Stokes equations to model the fluid flow and the immersed boundary method to handle the two-way, fluid-structure interaction in 2D, non-axisymmetric simulations. We used our model to evaluate the effects of chain length, contraction style, and adverse axial pressure difference (AAPD) on cycle-mean flow rates (CMFRs). In the model, longer lymphangion chains generally yield larger CMFRs, and they fail to generate positive CMFRs at higher AAPDs than shorter chains. Simultaneously contracting pumps generate the largest CMFRs at nearly every AAPD and for every chain length. Due to the contraction timing and valve dynamics, non-simultaneous pumps generate lower CMFRs than the simultaneous pumps; the discrepancy diminishes as the AAPD increases. Valve dynamics vary with the contraction style and exhibit hysteretic opening and closing behaviors. Our model provides insight into how contraction propagation affects flow rates and transport through a lymphangion chain.


title: Homotopy Covers of Graphs

abstract: We develop conditions for a graph cover to be a $\times$-homotopy cover, satisfying a $\times$-homotopy lifting property analogous to the homotopy lifting property of covers of topological spaces. We define a universal homotopy cover for graphs and show that homotopy covers as quotients of this universal cover by subgroups of the deck transformation group, which we identify with the fundamental groupoid defined in \cite{CS2}. We then explicitly compute the fundamental groups of cycle, wheel, complete and certain Kneser graphs, and use this to enumerate all connected homotopy covers of these graphs.


title: Double-trace deformation in Keldysh field theory

abstract: The Keldysh formalism is capable of describing driven-dissipative dynamics of open quantum systems as nonunitary effective field theories that are not necessarily thermodynamical, thus often exhibiting new physics. Here, we introduce a general Keldysh action that maximally obeys Weinbergian constraints, including locality, Poincar\'e invariance, and two "$CPT$" constraints: complete positivity and trace preserving as well as charge, parity, and time reversal symmetry. We find that the perturbative Lindblad term responsible for driven-dissipative dynamics introduced therein has the natural form of a double-trace deformation $\mathcal{O}^2$, which, in the large $N$ limit, possibly leads to a new nonthermal conformal fixed point. This fixed point is IR when $\Delta<d/2$ or UV when $\Delta>d/2$ given $d$ the dimensions of spacetime and $\Delta$ the scaling dimension of $\mathcal{O}$. Such a UV fixed point being not forbidden by Weinbergian constraints may suggest its existence and even completion of itself, in contrast to the common sense that dissipation effects are always IR relevant. This observation implies that driven-dissipative dynamics is much richer than thermodynamics, differing in not only its noncompliance with thermodynamic symmetry (e.g., the fluctuation-dissipation relation) but its UV/IR relevance as well. Examples including a $(0+1)$-$d$ harmonic oscillator under continuous measurement and a $(4-\epsilon)$-$d$ classic $O(N)$ vector model with quartic interactions are studied.


title: Probing secret interactions of eV-scale sterile neutrinos with the diffuse supernova neutrino background

abstract: While three flavors of "active" neutrinos are consistent with mixing angle results within error bars, there are anomalies may be hints of physics beyond the standard model that can accommodate a fourth mostly "sterile" neutrino species with an eV-scale mass and a mixing angle with active neutrinos of order $\theta_0\simeq 0.1$. We describe a scenario with eV-scale sterile neutrinos that have self-interactions via a new gauge vector boson, a "secret" mediator $\phi$. We show that their production in the early Universe via mixing with active neutrinos is consistent with Big Bang Nucleosynthesis and free-streaming constraints in the Cosmic Microwave Background epoch. For $M_\phi=4-8$ keV and sterile neutrino coupling $g_s=10^{-4}$, we find that resonant interactions of diffuse supernova neutrinos with relic sterile neutrinos in transit to the Earth would cause spectral dips in the neutrino flux. We illustrate the corresponding (anti-)neutrino event distributions as a function of energy in the DUNE (Hyper-Kamiokande) detector.


title: Random Interpolating Sequences in the Polydisc and the Unit Ball

abstract: We study almost sure separating and interpolating properties of random sequences in the polydisc and the unit ball. In the unit ball, we obtain the 0-1 Komolgorov law for a sequence to be interpolating almost surely for all the Besov-Sobolev spaces $B_{2}^{\sigma}\left(\mathbb{B}_{d}\right)$, in the range $0 < \sigma\leq1 / 2$. For those spaces, such interpolating sequences coincide with interpolating sequences for their multiplier algebras, thanks to the Pick property. This is not the case for the Hardy space $\mathrm{H}^2(\mathbb{D}^d)$ and its multiplier algebra $\mathrm{H}^\infty(\mathbb{D}^d)$: in the polydisc, we obtain a sufficient and a necessary condition for a sequence to be $\mathrm{H}^\infty(\mathbb{D}^d)$-interpolating almost surely. Those two conditions do not coincide, due to the fact that the deterministic starting point is less descriptive of interpolating sequences than its counterpart for the unit ball. On the other hand, we give the $0-1$ law for random interpolating sequences for $\mathrm{H}^2(\mathbb{D}^d)$.


title: Kohnert's rule for flagged Schur modules

abstract: Flagged Schur modules generalize the irreducible representations of the general linear group under the action of the Borel subalgebra. Their characters include many important generalizations of Schur polynomials, such as Demazure characters, flagged skew Schur polynomials, and Schubert polynomials. In this paper, we prove the characters of flagged Schur modules can be computed using a simple combinatorial algorithm due to Kohnert if and only if the indexing diagram is northwest. This gives a new proof that characters of flagged Schur modules are nonnegative sums of Demazure characters and gives a representation theoretic interpretation for Kohnert polynomials.


title: A Database of Dorsal Hand Vein Images

abstract: The dorsal hand vein has been demonstrated as a useful biometric for identity verification. This work details the procedure taken to collect two databases of dorsal hand veins in a biometric recognition project. The purpose of this work is to serve as a reference for the databases that are being shared with the public.


title: Swift Multiwavelength Follow-up of LVC S200224ca and the Implications for Binary Black Hole Mergers

abstract: On 2020 February 24, during their third observing run ("O3"), the Laser Interferometer Gravitational-wave Observatory and Virgo Collaboration (LVC) detected S200224ca: a candidate gravitational wave (GW) event produced by a binary black hole (BBH) merger. This event was one of the best-localized compact binary coalescences detected in O3 (with 50%/90% error regions of 13/72 deg$^2$), and so the Neil Gehrels Swift Observatory performed rapid near-UV/X-ray follow-up observations. Swift-XRT and UVOT covered approximately 79.2% and 62.4% (respectively) of the GW error region, making S200224ca the BBH event most thoroughly followed-up in near-UV (u-band) and X-ray to date. No likely EM counterparts to the GW event were found by the Swift BAT, XRT, or UVOT, nor by other observatories. Here we report on the results of our searches for an EM counterpart, both in the BAT data near the time of the merger, and in follow-up UVOT/XRT observations. We also discuss the upper limits we can place on EM radiation from S200224ca, and the implications these limits have on the physics of BBH mergers. Namely, we place a shallow upper limit on the dimensionless BH charge, $\hat{q} < 1.4 \times10^{-4}$, and an upper limit on the isotropic-equivalent energy of a blast wave $E < 4.1\times10^{51}$ erg (assuming typical GRB parameters).


title: Subset Sum Instances in ZFC Limbo

abstract: Our main result, Theorem 2.5, shows the existence of a vast infinity of subset sum problems solvable in polynomial time. The only proof we have of this result uses the ZFC independent Jump Free Theorem of Harvey Friedman, thus putting Theorem 2.5 in what we call ZFC limbo. The mathematics we use is elementary and at the level of a good undergraduate course in combinatorics or design and analysis of algorithms. The statement of the Jump Free Theorem is also easily understood at this level (but not the proof).


title: What Determines Unique Spectra of Super-Eddington Accretors?: Origin of Optically Thick and Low Temperature Coronae in Super-Eddington Accretion Flows

abstract: Existence of relatively cool ($k_B T \lesssim 10~{\rm keV}$) and optically thick ($\tau \gtrsim 3$) coronae are inferred above super-Eddington accretion flow such as ultraluminous X-ray sources (ULXs), GRS 1915+105, and narrow-line Seyfert 1 galaxies (NLS1), which contrasts the cases in sub-Eddington accretion flows, which are associated with coronae with $k_B T \sim 100~{\rm keV}$ and $\tau \sim 1$. To understand their physical origin, we investigate the emission properties of the corona which is formed by the gas blown off the super-Eddington inner disk by radiation pressure. We assume that the corona is heated by the reconnection of magnetic loops emerged from the underlying disk. We show that this radiation pressure driven wind can act as an optically thick corona which upscatters thermal soft photons from the underlying disk, and that with a reasonable parameter set we can theoretically reproduce the coronal optical depth and temperature which are inferred by spectral fittings of observational data. By contrast, the coronal optical depth cannot be so high in sub-Eddington cases, since the coronal material is supplied from the disk via evaporation and there is a maximum limit on the evaporation rate. We support that the low temperature, optically thick Comptonization should be a key signature of super-Eddington accretion flow.


title: Stochastic Optimization Models for Location and Inventory Prepositioning of Disaster Relief Supplies

abstract: We consider the problem of preparing for a disaster season by determining where to open warehouses and how much relief item inventory to preposition in each. Then, after each disaster, prepositioned items are distributed to demand nodes during the post-disaster phase, and additional items are procured and distributed as needed. There is often uncertainty in the disaster level, affected areas locations, the demand for relief items, the usable fraction of prepositioned items post-disaster, procurement quantity, and arc capacity. To address uncertainty, we propose and analyze two-stage stochastic programming (SP) and distributionally robust optimization (DRO) models, assuming known and unknown (ambiguous) uncertainty distributions. The first and second stages correspond to pre- and post-disaster phases, respectively. We also propose a model that minimizes the trade-off between considering distributional ambiguity and following distributional belief. We obtain near-optimal solutions of our SP model using sample average approximation and propose a computationally efficient decomposition algorithm to solve our DRO models. We conduct extensive experiments using a hurricane season and an earthquake as case studies to investigate these approaches' computational and operational performance.


title: Role of nuclear gluon distribution on particle production in heavy ion collisions

abstract: The transverse momentum spectra of hadrons is calculated from the unintegrated gluon distribution (UGD) within the $k_T$-factorization framework at small $x$. Starting from $pp$ collisions, the modification caused by the nuclear medium is incorporated in the UGD at high energies, which is related to the nuclear shadowing phenomenon. Moreover, we consider that particle production from minijet decaying is not enough to explain the $p_T$ spectra in $AA$ collisions due to collective phenomena that take place after the hard collision. The Boltzmann-Gibbs Blast Wave (BGBW) distribution is utilized in order to evaluate the distribution of particle production in equilibrium. Data from ALICE collaboration for $PbPb$ collisions at $\sqrt{s}=2.76$ TeV are analyzed and the nuclear modification factor for pion production is computed.


title: On the structure of Besse convex contact spheres

abstract: We consider convex contact spheres $Y$ all of whose Reeb orbits are closed. Any such $Y$ admits a stratification by the periods of closed Reeb orbits. We show that $Y$ "resembles" a contact ellipsoid: any stratum of $Y$ is an integral homology sphere, and the sequence of Ekeland-Hofer spectral invariants of $Y$ coincides with the full sequence of action values, each one repeated according to its multiplicity.


title: Ensemble Squared: A Meta AutoML System

abstract: There are currently many barriers that prevent non-experts from exploiting machine learning solutions ranging from the lack of intuition on statistical learning techniques to the trickiness of hyperparameter tuning. Such barriers have led to an explosion of interest in automated machine learning (AutoML), whereby an off-the-shelf system can take care of many of the steps for end-users without the need for expertise in machine learning. This paper presents Ensemble Squared (Ensemble$^2$), an AutoML system that ensembles the results of state-of-the-art open-source AutoML systems. Ensemble$^2$ exploits the diversity of existing AutoML systems by leveraging the differences in their model search space and heuristics. Empirically, we show that diversity of each AutoML system is sufficient to justify ensembling at the AutoML system level. In demonstrating this, we also establish new state-of-the-art AutoML results on the OpenML tabular classification benchmark.


title: Feasibility Assessment of a Cost-Effective Two-Wheel Kian-I Mobile Robot for Autonomous Navigation

abstract: A two-wheeled mobile robot, namely Kian-I, is designed and prototyped in this research. The Kian-I is comparable with Khepera-IV in terms of dimensional specifications, mounted sensors, and performance capabilities and can be used for educational purposes and cost-effective experimental tests. A motion control architecture is designed for Kian-I in this study to facilitate accurate navigation for the robot in an immersive environment. The implemented control structure consists of two main components of the path recommender system and trajectory tracking controller. Given partial knowledge about the operation field, the path recommender system adopts B-spline curves and Particle Swarm Optimization (PSO) algorithm to determine a collision-free path curve with translational velocity constraint. The provided optimal reference path feeds into the trajectory tracking controller enabling Kian-I to navigate autonomously in the operating field. The trajectory tracking module eliminate the error between the desired path and the followed trajectory through controlling the wheels' velocity. To assess the feasibility of the proposed control architecture, the performance of Kian-I robot in autonomous navigation from any arbitrary initial pose to a target of interest is evaluated through numerous simulation and experimental studies. The experimental results demonstrate the functional capacities and performance of the prototyped robot to be used as a benchmark for investigation and verification of various mobile robot algorithms in the laboratory environment.


title: Magnetism behavior of $T^{\prime}$-type Eu$_2$CuO$_4$ revealed by muon spin rotation/relaxation measurements

abstract: We performed muon spin rotation/relaxation measurements to investigate the magnetic behavior of $T^{\prime}$-type Eu$_2$CuO$_4$ (ECO), which is the parent compound of electron-doped cuprate superconductors, and the effects of oxygen-reduction annealing on its magnetism. In as-sintered (AS) ECO, we clarified the development of magnetic correlations upon cooling below $T_\mathrm{N1}$ (= 265 K) as well as the coexistence of a dominant fluctuating spin state and partially ordered spin state in the temperature range between $\sim$150 K and $T_\mathrm{N1}$. Upon further cooling, uniform long-range magnetic order was observed below $T_\mathrm{N2} = 110$ K, which is close to the ordering temperature of 115 K in $T^{\prime}$-type La$_2$CuO$_4$ (LCO) [Phys. Rev. B {\bf 82}, 180508(R) (2010)]. For oxygen-reduction-annealed ECO, a similar ordering sequence with the same $T_\mathrm{N2}$ was observed but without the partially ordered spin state. Therefore, the fluctuating spin state over a wide temperature range and a $T_\mathrm{N2}$ less than the N{\'e}el temperature ($T_\mathrm{N2} \approx T_\mathrm{N1}$) in $T$-type LCO are common features of the $T^{\prime}$-type parent $R_2$CuO$_4$ ($R$CO, $R$: rare-earth ion). The origin of the partially ordered spin state in AS ECO is discussed from the viewpoint of chemical defect. Furthermore, we discuss the roles of electron doping and repairing defect in the observed effect of annealing on the magnetism of $T^{\prime}$-type $R$CO.


title: Calibrationless MRI Reconstruction with a Plug-in Denoiser

abstract: Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides excellent soft-tissue contrast without using ionizing radiation. MRI's clinical application may be limited by long data acquisition time; therefore, MR image reconstruction from highly under-sampled k-space data has been an active research area. Calibrationless MRI not only enables a higher acceleration rate but also increases flexibility for sampling pattern design. To leverage non-linear machine learning priors, we pair our High-dimensional Fast Convolutional Framework (HICU) with a plug-in denoiser and demonstrate its feasibility using 2D brain data.


title: Cluster analysis and outlier detection with missing data

abstract: A mixture of multivariate contaminated normal (MCN) distributions is a useful model-based clustering technique to accommodate data sets with mild outliers. However, this model only works when fitted to complete data sets, which is often not the case in real applications. In this paper, we develop a framework for fitting a mixture of MCN distributions to incomplete data sets, i.e. data sets with some values missing at random. We employ the expectation-conditional maximization algorithm for parameter estimation. We use a simulation study to compare the results of our model and a mixture of Student's t distributions for incomplete data.


title: Infusing Finetuning with Semantic Dependencies

abstract: For natural language processing systems, two kinds of evidence support the use of text representations from neural language models "pretrained" on large unannotated corpora: performance on application-inspired benchmarks (Peters et al., 2018, inter alia), and the emergence of syntactic abstractions in those representations (Tenney et al., 2019, inter alia). On the other hand, the lack of grounded supervision calls into question how well these representations can ever capture meaning (Bender and Koller, 2020). We apply novel probes to recent language models -- specifically focusing on predicate-argument structure as operationalized by semantic dependencies (Ivanova et al., 2012) -- and find that, unlike syntax, semantics is not brought to the surface by today's pretrained models. We then use convolutional graph encoders to explicitly incorporate semantic parses into task-specific finetuning, yielding benefits to natural language understanding (NLU) tasks in the GLUE benchmark. This approach demonstrates the potential for general-purpose (rather than task-specific) linguistic supervision, above and beyond conventional pretraining and finetuning. Several diagnostics help to localize the benefits of our approach.


title: SSD-SSD: Communication sparsification for distributed deep learning training

abstract: Intensive communication and synchronization cost for gradients and parameters is the well-known bottleneck of distributed deep learning training. Based on the observations that Synchronous SGD (SSGD) obtains good convergence accuracy while asynchronous SGD (ASGD) delivers a faster raw training speed, we propose Several Steps Delay SGD (SSD-SGD) to combine their merits, aiming at tackling the communication bottleneck via communication sparsification. SSD-SGD explores both global synchronous updates in the parameter servers and asynchronous local updates in the workers in each periodic iteration. The periodic and flexible synchronization makes SSD-SGD achieve good convergence accuracy and fast training speed. To the best of our knowledge, we strike the new balance between synchronization quality and communication sparsification, and improve the trade-off between accuracy and training speed. Specifically, the core components of SSD-SGD include proper warm-up stage, steps delay stage, and our novel algorithm of global gradient for local update (GLU). GLU is critical for local update operations to effectively compensate the delayed local weights. Furthermore, we implement SSD-SGD on MXNet framework and comprehensively evaluate its performance with CIFAR-10 and ImageNet datasets. Experimental results show that SSD-SGD can accelerate distributed training speed under different experimental configurations, by up to 110%, while achieving good convergence accuracy.


title: An Integrated Search Framework for Leveraging the Knowledge-Based Web Ecosystem

abstract: The explosion of information constrains the judgement of search terms associated with Knowledge-Based Web Ecosystem (KBWE), making the retrieval of relevant information and its knowledge management challenging. The existing information retrieval (IR) tools and their fusion in a framework need attention, in which search results can effectively be managed. In this article, we demonstrate the effective use of information retrieval services by a variety of users and agents in various KBWE scenarios. An innovative Integrated Search Framework (ISF) is proposed, which utilises crawling strategies, web search technologies and traditional database search methods. Besides, ISF offers comprehensive, dynamic, personalized, and organization-oriented information retrieval services, ranging from the Internet, extranet, intranet, to personal desktop. In this empirical research, experiments are carried out demonstrating the improvements in the search process, as discerned in the conceptual ISF. The experimental results show improved precision compared with other popular search engines.


title: Hardness results for Multimarginal Optimal Transport problems

abstract: Multimarginal Optimal Transport (MOT) is the problem of linear programming over joint probability distributions with fixed marginals. A key issue in many applications is the complexity of solving MOT: the linear program has exponential size in the number of marginals k and their support sizes n. A recent line of work has shown that MOT is poly(n,k)-time solvable for certain families of costs that have poly(n,k)-size implicit representations. However, it is unclear what further families of costs this line of algorithmic research can encompass. In order to understand these fundamental limitations, this paper initiates the study of intractability results for MOT. Our main technical contribution is developing a toolkit for proving NP-hardness and inapproximability results for MOT problems. We demonstrate this toolkit by using it to establish the intractability of a number of MOT problems studied in the literature that have resisted previous algorithmic efforts. For instance, we provide evidence that repulsive costs make MOT intractable by showing that several such problems of interest are NP-hard to solve--even approximately.


title: Ultra-Narrow TaS2 Nanoribbons

abstract: Imposing additional confinement in two-dimensional (2D) materials can yield further control over the associated electronic, optical, and topological properties. However, synthesis of ultra-narrow nanoribbons (NRs) remains a challenge, particularly for the transition metal dichalcogenides (TMDs), and synthesizing TMD NRs narrower than 50 nm has remained elusive. Here, we report the vapor-phase synthesis of ultra-narrow TaS2 NRs. The NRs are grown within the hollow cavity of carbon nanotubes, thereby limiting their lateral dimensions and layer number, while simultaneously stabilizing them against the environment. The NRs reach the monolayer (ML) limit and exhibit widths as low as 2.5 nm. Atomic-resolution scanning transmission electron microscopy (STEM) reveals the detailed atomic structure of the ultra-narrow NRs and we observe a hitherto unseen atomic structure supermodulation phenomenon of ordered defect arrays within the NRs. First-principles calculations based on density functional theory (DFT) show the presence of flat bands, as well as edge- and boundary-localized states, and help identify the atomic configuration of the supermodulation. Nanotube-templated synthesis represents a unique, transferable, and broadly deployable route toward ultra-narrow TMD NR growth.


title: A Free Lunch for Unsupervised Domain Adaptive Object Detection without Source Data

abstract: Unsupervised domain adaptation (UDA) assumes that source and target domain data are freely available and usually trained together to reduce the domain gap. However, considering the data privacy and the inefficiency of data transmission, it is impractical in real scenarios. Hence, it draws our eyes to optimize the network in the target domain without accessing labeled source data. To explore this direction in object detection, for the first time, we propose a source data-free domain adaptive object detection (SFOD) framework via modeling it into a problem of learning with noisy labels. Generally, a straightforward method is to leverage the pre-trained network from the source domain to generate the pseudo labels for target domain optimization. However, it is difficult to evaluate the quality of pseudo labels since no labels are available in target domain. In this paper, self-entropy descent (SED) is a metric proposed to search an appropriate confidence threshold for reliable pseudo label generation without using any handcrafted labels. Nonetheless, completely clean labels are still unattainable. After a thorough experimental analysis, false negatives are found to dominate in the generated noisy labels. Undoubtedly, false negatives mining is helpful for performance improvement, and we ease it to false negatives simulation through data augmentation like Mosaic. Extensive experiments conducted in four representative adaptation tasks have demonstrated that the proposed framework can easily achieve state-of-the-art performance. From another view, it also reminds the UDA community that the labeled source data are not fully exploited in the existing methods.


title: Generic Regularity of Minimal Hypersurfaces in Dimension 8

abstract: In this paper, we show that every $8$-dimensional closed Riemmanian manifold with $C^\infty$-generic metrics admits a smooth minimal hypersurface. This generalized previous results by N. Smale and Chodosh-Liokumovich-Spolaor. Different from their local perturbation techniques, our construction is based on a global perturbation argument in and a novel geometric invariant which counts singular points with suitable weights.


title: Data-Driven Intersection Management Solutions for Mixed Traffic of Human-Driven and Connected and Automated Vehicles

abstract: This dissertation proposes two solutions for urban traffic control in the presence of connected and automated vehicles. First a centralized platoon-based controller is proposed for the cooperative intersection management problem that takes advantage of the platooning systems and V2I communication to generate fast and smooth traffic flow at a single intersection. Second, a data-driven approach is proposed for adaptive signal control in the presence of connected vehicles. The proposed system relies on a data-driven method for optimal signal timing and a data-driven heuristic method for estimating routing decisions. It requires no additional sensors to be installed at the intersection, reducing the installation costs compared to typical settings of state-of-the-practice adaptive signal controllers. The proposed traffic controller contains an optimal signal timing module and a traffic state estimator. The signal timing module is a neural network model trained on microscopic simulation data to achieve optimal results according to a given performance metric such as vehicular delay or average queue length. The traffic state estimator relies on connected vehicles' information to estimate the traffic's routing decisions. A heuristic method is proposed to minimize the estimation error. With sufficient parameter tuning, the estimation error decreases as the market penetration rate (MPR) of connected vehicles grows. Estimation error is below 30% for an MPR of 10% and it shrinks below 20% when MPR grows larger than 30%. Simulations showed that the proposed traffic controller outperforms Highway Capacity Manual's methodology and given proper offline parameter tuning, it can decrease average vehicular delay by up to 25%.


title: Research Challenges in Designing Differentially Private Text Generation Mechanisms

abstract: Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a generalized form of Differential Privacy to provide guarantees over text queries. Such mechanisms add privacy preserving noise to vectorial representations of text in high dimension and return a text based projection of the noisy vectors. However, these mechanisms are sub-optimal in their trade-off between privacy and utility. This is due to factors such as a fixed global sensitivity which leads to too much noise added in dense spaces while simultaneously guaranteeing protection for sensitive outliers. In this proposal paper, we describe some challenges in balancing the tradeoff between privacy and utility for these differentially private text mechanisms. At a high level, we provide two proposals: (1) a framework called LAC which defers some of the noise to a privacy amplification step and (2), an additional suite of three different techniques for calibrating the noise based on the local region around a word. Our objective in this paper is not to evaluate a single solution but to further the conversation on these challenges and chart pathways for building better mechanisms.


title: A truncated minimal free resolution of the residue field

abstract: In a paper in 1962, Golod proved that the Betti sequence of the residue field of a local ring attains an upper bound given by Serre if and only if the homology algebra of the Koszul complex of the ring has trivial multiplications and trivial Massey operations. This is the origin of the notion of Golod ring. Using the Koszul complex components he also constructed a minimal free resolution of the residue field. In this article, we extend this construction up to degree five for any local ring. We describe how the multiplicative structure and the triple Massey products of the homology of the Koszul algebra are involved in this construction. As a consequence, we provide explicit formulas for the first six terms of a sequence that measures how far the ring is from being Golod.


title: PoolTestR: An R package for estimating prevalence and regression modelling with pooled samples

abstract: Pooled testing (also known as group testing), where diagnostic tests are performed on pooled samples, has broad applications in the surveillance of diseases in animals and humans. An increasingly common use case is molecular xenomonitoring (MX), where surveillance of vector-borne diseases is conducted by capturing and testing large numbers of vectors (e.g. mosquitoes). The R package PoolTestR was developed to meet the needs of increasingly large and complex molecular xenomonitoring surveys but can be applied to analyse any data involving pooled testing. PoolTestR includes simple and flexible tools to estimate prevalence and fit fixed- and mixed-effect generalised linear models for pooled data in frequentist and Bayesian frameworks. Mixed-effect models allow users to account for the hierarchical sampling designs that are often employed in surveys, including MX. We demonstrate the utility of PoolTestR by applying it to a large synthetic dataset that emulates a MX survey with a hierarchical sampling design.


title: $SU(4)$ Flavorful Portal Matter

abstract: In this paper, we present a model which attempts to unify a new dark sector force with a local $SU(3)$ flavor symmetry. Dark Matter (DM) and its potential interactions with the Standard Model (SM) continue to present a rich framework for model building. In the case of thermal DM of a mass between a few MeV and a few GeV, a compelling and much-explored framework is that of a dark photon/vector portal, which posits a new $U(1)$ "dark photon" which only couples to the SM via small kinetic mixing (KM) with the SM hypercharge. This mixing can be mediated at the one-loop level by portal matter (PM) fields which are charged under both the dark $U(1)$ and the SM gauge group. In earlier work, one of the authors has noted that models with appropriate portal matter content to produce finite and calculable kinetic mixing can arise from non-minimal dark sectors, in which the dark $U(1)$ is a subgroup of a larger gauge symmetry under which SM particles might have non-trivial representations. We expand on this idea here by constructing a model in which in which the dark $U(1)$ is unified with another popular extension to the SM gauge group, a local $SU(3)$ flavor symmetry. The full dark/flavor symmetry group is $SU(4)_F \times U(1)_F$, incorporating the local $SU(3)$ flavor symmetry with PM appearing as a vector-like "fourth generation" to supplement the three generations of the SM. To ensure finite contributions to KM, the SM gauge group is arranged into Pati-Salam multiplets. The new extended dark gauge group presents a variety of interesting experimental signatures, including non-trivial consequences of the flavor symmetry being unified with the dark sector.


title: Magnetic field and chromospheric activity evolution of HD75332: a rapid magnetic cycle in an F star without a hot Jupiter

abstract: Studying cool star magnetic activity gives an important insight into the stellar dynamo and its relationship with stellar properties, as well as allowing us to place the Sun's magnetism in the context of other stars. Only 61 Cyg A (K5V) and $\tau$ Boo (F8V) are currently known to have magnetic cycles like the Sun's, where the large-scale magnetic field polarity reverses in phase with the star's chromospheric activity cycles. ${\tau}$ Boo has a rapid $\sim$240 d magnetic cycle, and it is not yet clear whether this is related to the star's thin convection zone or if the dynamo is accelerated by interactions between ${\tau}$ Boo and its hot Jupiter. To shed light on this, we studied the magnetic activity of HD75332 (F7V) which has similar physical properties to ${\tau}$ Boo and does not appear to host a hot Jupiter. We characterized its long term chromospheric activity variability over 53 yrs and used Zeeman Doppler Imaging to reconstruct the large-scale surface magnetic field for 12 epochs between 2007 and 2019. Although we observe only one reversal of the large-scale magnetic dipole, our results suggest that HD75332 has a rapid $\sim$1.06 yr solar-like magnetic cycle where the magnetic field evolves in phase with its chromospheric activity. If a solar-like cycle is present, reversals of the large-scale radial field polarity are expected to occur at around activity cycle maxima. This would be similar to the rapid magnetic cycle observed for ${\tau}$ Boo, suggesting that rapid magnetic cycles may be intrinsic to late-F stars and related to their shallow convection zones.


title: Improved simulation of El Ni\~no and its influence on the climate anomalies of the East Asia-western North Pacific in the ICM Version 2

abstract: This study introduces the second version of the Integrated Climate Model (ICM). ICM is developed by the Center for Monsoon System Research, Institute of Atmospheric Physics to improve the short-term climate prediction of the East Asia-western North Pacific (EA-WNP). The main update of the second version of ICM (ICM.V2) relative to the first version (ICM.V1) is the improvement of the horizontal resolution of the atmospheric model from T31 spectral resolution (3.75{\deg}*3.75{\deg}) to T63 (1.875{\deg}*1.875{\deg}). As a result, some important factors for the short-term climate prediction of the EA-WNP is apparently improved from ICM.V1 to ICM.V2, including the climatological SST, the rainfall and circulation of the East Asian summer monsoon, and the variability and spatial pattern of ENSO. The impact of El Ni\~no on the EA-WNP climate simulated in ICM.V2 is also improved with more realistic anticyclonic anomalies and precipitation pattern over the EA-WNP. The tropical Indian ocean capacitor effect and the WNP local air-sea interaction feedback, two popular mechanisms to explain the impact of El Ni\~no on the EA-WNP climate is also realistically reproduced in ICM.V2, much improved relative to that in ICM.V1.


title: Accelerated Randomized Methods for Receiver Design in Extra-Large Scale MIMO Arrays

abstract: Massive multiple-input-multiple-output (M-MIMO) features a capability for spatial multiplexing of large number of users. This number becomes even more extreme in extra-large (XL-MIMO), a variant of M-MIMO where the antenna array is of very large size. Yet, the problem of signal processing complexity in M-MIMO is further exacerbated by the XL size of the array. The basic processing problem boils down to a sparse system of linear equations that can be addressed by the randomized Kaczmarz (RK) algorithm. This algorithm has recently been applied to devise low-complexity M-MIMO receivers; however, it is limited by the fact that certain configurations of the linear equations may significantly deteriorate the performance of the RK algorithm. In this paper, we embrace the interest in accelerated RK algorithms and introduce three new RK-based low-complexity receiver designs. In our experiments, our methods are not only able to overcome the previous scheme, but they are more robust against inter-user interference (IUI) and sparse channel matrices arising in the XL-MIMO regime. In addition, we show that the RK-based schemes use a mechanism similar to that used by successive interference cancellation (SIC) receivers to approximate the regularized zero-forcing (RZF) scheme.


title: Artificial Intelligence at the Edge

abstract: The Internet of Things (IoT) and edge computing applications aim to support a variety of societal needs, including the global pandemic situation that the entire world is currently experiencing and responses to natural disasters. The need for real-time interactive applications such as immersive video conferencing, augmented/virtual reality, and autonomous vehicles, in education, healthcare, disaster recovery and other domains, has never been higher. At the same time, there have been recent technological breakthroughs in highly relevant fields such as artificial intelligence (AI)/machine learning (ML), advanced communication systems (5G and beyond), privacy-preserving computations, and hardware accelerators. 5G mobile communication networks increase communication capacity, reduce transmission latency and error, and save energy -- capabilities that are essential for new applications. The envisioned future 6G technology will integrate many more technologies, including for example visible light communication, to support groundbreaking applications, such as holographic communications and high precision manufacturing. Many of these applications require computations and analytics close to application end-points: that is, at the edge of the network, rather than in a centralized cloud. AI techniques applied at the edge have tremendous potential both to power new applications and to need more efficient operation of edge infrastructure. However, it is critical to understand where to deploy AI systems within complex ecosystems consisting of advanced applications and the specific real-time requirements towards AI systems.


title: Plasma Switch-Based Technology for High-Speed and High-Power Impedance Tuning

abstract: This paper introduces a new technology for a high-speed, high-power mobile form-factor tuner utilizing gas discharge tube plasma cells as switching components. To the best of our knowledge, this represents the first plasma-enabled RF matching network. Technology development is reviewed, the fabrication and measurement of a proof-of-concept switched stub impedance tuner are presented, and techniques for improvement are discussed. The proof-of-concept impedance tuner functions with a 27% bandwidth from 3 to almost 4 GHz and shows a power gain better than -2.5 dB across all switching state-frequency combinations at a 50 W input power level with spread coverage of the Smith chart. State change transient timing is measured to be on the order of 500 ns. This technology demonstration highlights the potential of miniaturized, rapidly-tunable, high-power, plasma-based RF devices.


title: LaSeSOM: A Latent and Semantic Representation Framework for Soft Object Manipulation

abstract: Soft object manipulation has recently gained popularity within the robotics community due to its potential applications in many economically important areas. Although great progress has been recently achieved in these types of tasks, most state-of-the-art methods are case-specific; They can only be used to perform a single deformation task (e.g. bending), as their shape representation algorithms typically rely on "hard-coded" features. In this paper, we present LaSeSOM, a new feedback latent representation framework for semantic soft object manipulation. Our new method introduces internal latent representation layers between low-level geometric feature extraction and high-level semantic shape analysis; This allows the identification of each compressed semantic function and the formation of a valid shape classifier from different feature extraction levels. The proposed latent framework makes soft object representation more generic (independent from the object's geometry and its mechanical properties) and scalable (it can work with 1D/2D/3D tasks). Its high-level semantic layer enables to perform (quasi) shape planning tasks with soft objects, a valuable and underexplored capability in many soft manipulation tasks. To validate this new methodology, we report a detailed experimental study with robotic manipulators.


title: The Lennard Jones Potential Revisited -- Analytical Expressions for Vibrational Effects in Cubic and Hexagonal Close-Packed Lattices

abstract: Analytical formulae are derived for the zero-point vibrational energy and anharmonicity corrections of the cohesive energy and the mode Gr\"{u}neisen parameter within the Einstein model for the cubic lattices (sc, bcc and fcc) and for the hexagonal close-packed structure. This extends the work done by Lennard Jones and Ingham in 1924, Corner in 1939 and Wallace in 1965. The formulae are based on the description of two-body energy contributions by an inverse power expansion (extended Lennard-Jones potential). These make use of three-dimensional lattice sums, which can be transformed to fast converging series and accurately determined by various expansion techniques. We apply these new lattice sum expressions to the rare gas solids and discuss associated critical points. The derived formulae give qualitative but nevertheless deep insight into vibrational effects in solids from the lightest (helium) to the heaviest rare gas element (oganesson), both presenting special cases because of strong quantum effects for the former and strong relativistic effects for the latter.


title: Rewriter-Evaluator Architecture for Neural Machine Translation

abstract: Encoder-decoder has been widely used in neural machine translation (NMT). A few methods have been proposed to improve it with multiple passes of decoding. However, their full potential is limited by a lack of appropriate termination policies. To address this issue, we present a novel architecture, Rewriter-Evaluator. It consists of a rewriter and an evaluator. Translating a source sentence involves multiple passes. At every pass, the rewriter produces a new translation to improve the past translation and the evaluator estimates the translation quality to decide whether to terminate the rewriting process. We also propose prioritized gradient descent (PGD) that facilitates training the rewriter and the evaluator jointly. Though incurring multiple passes of decoding, Rewriter-Evaluator with the proposed PGD method can be trained with a similar time to that of training encoder-decoder models. We apply the proposed architecture to improve the general NMT models (e.g., Transformer). We conduct extensive experiments on two translation tasks, Chinese-English and English-German, and show that the proposed architecture notably improves the performances of NMT models and significantly outperforms previous baselines.


title: Diffusion of active particles with angular velocity reversal

abstract: Biological and synthetic microswimmers display a wide range of swimming trajectories depending on driving forces and torques. In this paper we consider a simple overdamped model of self-propelled particles with a constant self-propulsion speed, but an angular velocity that varies in time. Specifically, we consider the case of both deterministic and stochastic angular velocity reversal, mimicking several synthetic active matter systems like propelled droplets. The orientational correlation function and effective diffusivity is studied using Langevin dynamics simulations and perturbative methods.


title: The SYZ mirror symmetry conjecture for del Pezzo surfaces and rational elliptic surfaces

abstract: We prove a version of the Strominger-Yau-Zaslow mirror symmetry conjecture for non-compact Calabi-Yau surfaces arising from, on the one hand, pairs $(\check{Y},\check{D})$ of a del Pezzo surface $\check{Y}$ and $\check{D}$ a smooth anti-canonical divisor and, on the other hand, pairs $(Y,D)$ of a rational elliptic surface $Y$, and $D$ a singular fiber of Kodaira type $I_k$. Three main results are established concerning the latter pairs $(Y,D)$. First, adapting work of Hein \cite{Hein}, we prove the existence of a complete Calabi-Yau metric on $Y\setminus D$ asymptotic to a (generically non-standard) semi-flat metric in every K\"ahler class. Secondly, we prove a uniqueness theorem to the effect that, modulo automorphisms, every K\"ahler class on $Y\setminus D$ admits a unique asymptotically semi-flat Calabi-Yau metric. This result yields a finite dimensional K\"ahler moduli space of Calabi-Yau metrics on $Y\setminus D$. Further, this result answers, in this setting, questions of Tian-Yau and Yau. Thirdly, building on the authors' previous work, we prove that $Y\setminus D$ equipped with an asymptotically semi-flat Calabi-Yau metric $\omega_{CY}$ admits a special Lagrangian fibration whenever the de Rham cohomology class of $\omega_{CY}$ is not topologically obstructed. Combining these results we define a mirror map from the moduli space of del Pezzo pairs $(\check{Y}, \check{D})$ to the complexified K\"ahler moduli of $(Y,D)$ and prove that the special Lagrangian fibration on $(Y,D)$ is $T$-dual to the special Lagrangian fibration on $(\check{Y}, \check{D})$ previously constructed by the authors. We give some applications of these results, including to the study of automorphisms of del Pezzo surfaces fixing an anti-canonical divisor.


title: An Efficient Asynchronous Method for Integrating Evolutionary and Gradient-based Policy Search

abstract: Deep reinforcement learning (DRL) algorithms and evolution strategies (ES) have been applied to various tasks, showing excellent performances. These have the opposite properties, with DRL having good sample efficiency and poor stability, while ES being vice versa. Recently, there have been attempts to combine these algorithms, but these methods fully rely on synchronous update scheme, making it not ideal to maximize the benefits of the parallelism in ES. To solve this challenge, asynchronous update scheme was introduced, which is capable of good time-efficiency and diverse policy exploration. In this paper, we introduce an Asynchronous Evolution Strategy-Reinforcement Learning (AES-RL) that maximizes the parallel efficiency of ES and integrates it with policy gradient methods. Specifically, we propose 1) a novel framework to merge ES and DRL asynchronously and 2) various asynchronous update methods that can take all advantages of asynchronism, ES, and DRL, which are exploration and time efficiency, stability, and sample efficiency, respectively. The proposed framework and update methods are evaluated in continuous control benchmark work, showing superior performance as well as time efficiency compared to the previous methods.


title: Segmenting Natural Language Sentences via Lexical Unit Analysis

abstract: In this work, we present Lexical Unit Analysis (LUA), a framework for general sequence segmentation tasks. Given a natural language sentence, LUA scores all the valid segmentation candidates and utilizes dynamic programming (DP) to extract the maximum scoring one. LUA enjoys a number of appealing properties such as inherently guaranteeing the predicted segmentation to be valid and facilitating globally optimal training and inference. Besides, the practical time complexity of LUA can be reduced to linear time, which is very efficient. We have conducted extensive experiments on 5 tasks, including syntactic chunking, named entity recognition (NER), slot filling, Chinese word segmentation, and Chinese part-of-speech (POS) tagging, across 15 datasets. Our models have achieved the state-of-the-art performances on 13 of them. The results also show that the F1 score of identifying long-length segments is notably improved.


title: A Custom 7nm CMOS Standard Cell Library for Implementing TNN-based Neuromorphic Processors

abstract: A set of highly-optimized custom macro extensions is developed for a 7nm CMOS cell library for implementing Temporal Neural Networks (TNNs) that can mimic brain-like sensory processing with extreme energy efficiency. A TNN prototype (13,750 neurons and 315,000 synapses) for MNIST requires only 1.56mm2 die area and consumes only 1.69mW.


title: On the emergence of simplex symmetry in the final and penultimate layers of neural network classifiers

abstract: A recent numerical study observed that neural network classifiers enjoy a large degree of symmetry in the penultimate layer. Namely, if $h(x) = Af(x) +b$ where $A$ is a linear map and $f$ is the output of the penultimate layer of the network (after activation), then all data points $x_{i, 1}, \dots, x_{i, N_i}$ in a class $C_i$ are mapped to a single point $y_i$ by $f$ and the points $y_i$ are located at the vertices of a regular $k-1$-dimensional standard simplex in a high-dimensional Euclidean space. We explain this observation analytically in toy models for highly expressive deep neural networks. In complementary examples, we demonstrate rigorously that even the final output of the classifier $h$ is not uniform over data samples from a class $C_i$ if $h$ is a shallow network (or if the deeper layers do not bring the data samples into a convenient geometric configuration).


title: RLeave: an in silico cross-validation protocol for transcript differential expression analysis

abstract: Background and Objective: The massive parallel sequencing technology facilitates new discoveries in terms of transcript differential analysis; however, all the new findings must be validated, since the diversity of transcript expression may impair the identification of the most relevant ones. Methods: The proposed RLeave algorithm (implemented in the R environment) utilizes a combination of conventional analysis (classic edgeR) together with other mathematical methods (Leave-one-out sample technique and Decision Trees validation) to identify more relevant candidates to be in vitro or in silico validated. Results: The RLeave protocol was tested using miRNome expression analysis of two sample groups (diabetes mellitus and acute lymphoblastic leukemia), and both had their most important differentially expressed miRNA confirmed by RT-qPCR. Conclusion: This protocol is applicable in RNA-SEQ research, highlighting the most relevant transcripts for in silico and/or in vitro validation.


title: Exploiting Group-level Behavior Pattern forSession-based Recommendation

abstract: Session-based recommendation (SBR) is a challenging task, which aims to predict users' future interests based on anonymous behavior sequences. Existing methods leverage powerful representation learning approaches to encode sessions into a low-dimensional space. However, despite such achievements, all the existing studies focus on the instance-level session learning, while neglecting the group-level users' preference, which is significant to model the users' behavior. To this end, we propose a novel Repeat-aware Neural Mechanism for Session-based Recommendation (RNMSR). In RNMSR, we propose to learn the user preference from both instance-level and group-level, respectively: (i) instance-level, which employs GNNs on a similarity-based item-pairwise session graph to capture the users' preference in instance-level. (ii) group-level, which converts sessions into group-level behavior patterns to model the group-level users' preference. In RNMSR, we combine instance-level user preference and group-level user preference to model the repeat consumption of users, \ie whether users take repeated consumption and which items are preferred by users. Extensive experiments are conducted on three real-world datasets, \ie Diginetica, Yoochoose, and Nowplaying, demonstrating that the proposed method consistently achieves state-of-the-art performance in all the tests.


title: Combining Transit and RV: A Synthesized Population Model

abstract: We present a framework for estimating exoplanet occurrence rates by synthesizing constraints from radial velocity and transit surveys simultaneously. We employ approximate Bayesian computation and various mass-radius (M-R) relations to explore the population models describing these surveys, both separately and in a joint fit. Using this approach, we fit a planet distribution function of the form $d^{2} N/d\log{P}d\log{M} \propto P^{\beta} M^{\alpha}$, with a break in the power law in mass at $M_{b}$, to planets orbiting FGK stars with periods $P = [25, 200]$ days and masses $M = [2, 50] M_{\oplus}$. We find that the M-R relation from Otegi et al. (2020), which lets rocky and volatile-rich populations overlap in mass, allows us to find a model that is consistent with both types of surveys. Our joint fit gives $M_{b} = 21.6_{-3.2}^{+2.5} M_{\oplus}$ (errors reflect 68.3% credible interval). This is nearly a factor of three higher than the break from transit-only considerations and an M-R relation without such an overlap. The corresponding planet-star mass ratio break $q_{b} \sim 7\times10^{-5}$ may be consistent with microlensing studies ($q_b \sim 6\times10^{-5} - 2\times10^{-4}$). The joint fit also requires that a fraction of $F_{\text{rocky}} = 0.63_{-0.04}^{+0.04}$ planets in the overlap region belong to the rocky population. Our results strongly suggest that future M-R relations should account for a mixture of distinct types of planets in order to describe the observed planet population.


title: Energy and entropy compensation, phase transition and kinetics of four dimensional charged Gauss-Bonnet Anti-de Sitter black holes on the underlying free energy landscape

abstract: We study the phase transition and the kinetics of the four dimensional charged AdS black hole in GB gravity based on the free energy landscape. Below the critical temperature, the free energy landscape topography has the shape of double basins with each representing one stable/unstable black hole phase. The thermodynamic small/large black hole phase transition is determined by the equal depths of the basins. We also demonstrate the underlying kinetics of the phase transition by studying the time evolution of the probability distribution of the state in the ensemble as well as the MFPT and the kinetic fluctuation of the state switching process caused by the thermal fluctuations. The final distribution is determined by the Boltzmann law and the MFPT and its fluctuation are closely related to the free energy landscape topography through barrier heights and ensemble temperature. Furthermore, we provide a complete description of the kinetics of phase transition with different physical parameters. The free energy is the result of the delicate balance and competition between the two relatively large numbers, the energy and entropy multiplied by temperature. Low energy and low entropy can give rise to a stable thermodynamic state in terms of free energy minimum (energy/mass preferred) while the high energy and high entropy can also give rise to a stable state in terms of free energy minimum. When the GB coupling constant increases, or the electric charge (potential) increases, or the pressure (absolute value of cosmological constant) decreases, it is easier for the small black hole state to escape to the large black hole state. Meanwhile, the inverse process becomes harder, i.e. the small (large) black hole state becomes less (more) stable.


title: Warped Information and Entanglement Islands in AdS/WCFT

abstract: We use the notion of double holography to study Hawking radiation emitted by the eternal BTZ black hole in equilibrium with a thermal bath, but in the form of warped CFT$_2$ degrees of freedom. In agreement with the literature, we find entanglement islands and a phase transition in the entanglement surface, but our results differ significantly from work in AdS/CFT in three major ways: (1) the late-time entropy decreases in time, (2) island degrees of freedom exist at all times, and not just at late times, with the phase transition changing whether or not these degrees of freedom include the black hole interior, and (3) the physics involves a field-theoretic IR divergence, emerging when the boundary interval is too big relative to the black hole's inverse temperature. This behavior in the entropy appears to be consistent with the non-unitarity of holographic warped CFT$_2$ and demonstrates that the islands are not a phenomenon restricted to black hole information in unitary setups.


title: Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition

abstract: In many scenarios, named entity recognition (NER) models severely suffer from unlabeled entity problem, where the entities of a sentence may not be fully annotated. Through empirical studies performed on synthetic datasets, we find two causes of performance degradation. One is the reduction of annotated entities and the other is treating unlabeled entities as negative instances. The first cause has less impact than the second one and can be mitigated by adopting pretraining language models. The second cause seriously misguides a model in training and greatly affects its performances. Based on the above observations, we propose a general approach, which can almost eliminate the misguidance brought by unlabeled entities. The key idea is to use negative sampling that, to a large extent, avoids training NER models with unlabeled entities. Experiments on synthetic datasets and real-world datasets show that our model is robust to unlabeled entity problem and surpasses prior baselines. On well-annotated datasets, our model is competitive with the state-of-the-art method.


title: Cooling of young neutron stars and dark gauge bosons

abstract: The standard cooling scenario in the presence of nucleon superfluidity fits rather well to the observation of the neutron stars. It implies that the stellar cooling arguments could place a stringent constraint on the properties of novel particles. We study in particular the cooling rate induced by dark gauge bosons for very young neutron stars: remnants of Cassiopeia A and SN1987A. The cooling is dominantly contributed either by the nucleon pair breaking and formation in the core or by the electron bremsstrahlung in the crust, depending on the age of the stars and the form of the couplings. We compute how much the cooling curve of the young neutron stars could be modified by the extra dark gauge boson emission and obtain the bound for the dark gauge boson when its mass is lower than $\mathcal{O}(0.1)\,{\rm MeV}$; for the dark photon we find the mixing parameter times its mass $\varepsilon m_{\gamma^\prime} < 1.5 \times 10^{-8}\,{\rm MeV}$ and for the ${\rm U}(1)_{B-L}$ gauge boson its coupling to nucleons and electrons $e^\prime < 10^{-13}$. We also discuss the possibility that the rapid cooling of Cas A might provide a hint for the existence of the ${\rm U}(1)_{B-L}$ gauge boson.


title: Dimensional analysis of spring-wing systems reveals performance metrics for resonant flapping-wing flight

abstract: Flapping-wing insects, birds, and robots are thought to offset the high power cost of oscillatory wing motion by using elastic elements for energy storage and return. Insects possess highly resilient elastic regions in their flight anatomy that may enable high dynamic efficiency. However, recent experiments highlight losses due to damping in the insect thorax that could reduce the benefit of those elastic elements. We performed experiments on, and simulations of a dynamically-scaled robophysical flapping model with an elastic element and biologically-relevant structural damping to elucidate the roles of body mechanics, aerodynamics, and actuation in spring-wing energetics. We measured oscillatory flapping wing dynamics and energetics subject to a range of actuation parameters, system inertia, and spring elasticity. To generalize these results, we derive the non-dimensional spring-wing equation of motion and present variables that describe the resonance properties of flapping systems: $N$, a measure of the relative influence of inertia and aerodynamics, and $\hat{K}$, the reduced stiffness. We show that internal damping scales with $N$, revealing that dynamic efficiency monotonically decreases with increasing $N$. Based on these results, we introduce a general framework for understanding the roles of internal damping, aerodynamic and inertial forces, and elastic structures within all spring-wing systems.


title: Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition

abstract: In recent years, speech emotion recognition technology is of great significance in industrial applications such as call centers, social robots and health care. The combination of speech recognition and speech emotion recognition can improve the feedback efficiency and the quality of service. Thus, the speech emotion recognition has been attracted much attention in both industry and academic. Since emotions existing in an entire utterance may have varied probabilities, speech emotion is likely to be ambiguous, which poses great challenges to recognition tasks. However, previous studies commonly assigned a single-label or multi-label to each utterance in certain. Therefore, their algorithms result in low accuracies because of the inappropriate representation. Inspired by the optimally interacting theory, we address the ambiguous speech emotions by proposing a novel multi-classifier interactive learning (MCIL) method. In MCIL, multiple different classifiers first mimic several individuals, who have inconsistent cognitions of ambiguous emotions, and construct new ambiguous labels (the emotion probability distribution). Then, they are retrained with the new labels to interact with their cognitions. This procedure enables each classifier to learn better representations of ambiguous data from others, and further improves the recognition ability. The experiments on three benchmark corpora (MAS, IEMOCAP, and FAU-AIBO) demonstrate that MCIL does not only improve each classifier's performance, but also raises their recognition consistency from moderate to substantial.


title: Building Graphs at a Large Scale: Union Find Shuffle

abstract: Large scale graph processing using distributed computing frameworks is becoming pervasive and efficient in the industry. In this work, we present a highly scalable and configurable distributed algorithm for building connected components, called Union Find Shuffle (UFS) with Path Compression. The scale and complexity of the algorithm are a function of the number of partitions into which the data is initially partitioned, and the size of the connected components. We discuss the complexity and the benchmarks compared to similar approaches. We also present current benchmarks of our production system, running on commodity out-of-the-box cloud Hadoop infrastructure, where the algorithm was deployed over a year ago, scaled to around 75 Billion nodes and 60 Billions linkages (and growing). We highlight the key aspects of our algorithm which enable seamless scaling and performance even in the presence of skewed data with large connected components in the size of 10 Billion nodes each.


title: Theory of shock electrodialysis I: Water dissociation and electrosmotic vortices

abstract: Shock electrodialysis (shock ED), an emerging electrokinetic process for water purification, leverages the new physics of deionization shock waves in porous media. In previous work, a simple leaky membrane model with surface conduction can explain the propagation of deionization shocks in a shock ED system, but it cannot quantitatively predict the deionization and conductance (which determines the energy consumption), and it cannot explain the selective removal of ions in experiments. This two-part series of work establishes a more comprehensive model for shock ED, which applies to multicomponent electrolytes and any electrical double layer thickness, captures the phenomena of electroosmosis, diffusioosmosis, and water dissociation, and incorporates more realistic boundary conditions. In this paper, we will present the model details and show that hydronium transport and electroosmotic vortices (at the inlet and outlet) play important roles in determining the deionization and conductance in shock ED. We also find that the results are quantitatively consistent with experimental data in the literature. Finally, the model is used to investigate design strategies for scale up and optimization.


title: Low-rank matrix estimation in multi-response regression with measurement errors: Statistical and computational guarantees

abstract: In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm regularizer is proposed to estimate the matrix parameter. Then under the (near) low-rank assumption, we analyse statistical and computational theoretical properties of global solutions of the nonconvex regularized estimator from a general point of view. In the statistical aspect, we establish the nonasymptotic recovery bound for any global solution of the nonconvex estimator, under restricted strong convexity on the loss function. In the computational aspect, we solve the nonconvex optimization problem via the proximal gradient method. The algorithm is proved to converge to a near-global solution and achieve a linear convergence rate. In addition, we also verify sufficient conditions for the general results to be held, in order to obtain probabilistic consequences for specific types of measurement errors, including the additive noise and missing data. Finally, theoretical consequences are demonstrated by several numerical experiments on corrupted errors-in-variables multi-response regression models. Simulation results reveal excellent consistency with our theory under high-dimensional scaling.


title: Communication-Computation Efficient Secure Aggregation for Federated Learning

abstract: Federated learning has been spotlighted as a way to train neural networks using distributed data with no need for individual nodes to share data. Unfortunately, it has also been shown that adversaries may be able to extract local data contents off model parameters transmitted during federated learning. A recent solution based on the secure aggregation primitive enabled privacy-preserving federated learning, but at the expense of significant extra communication/computational resources. In this paper, we propose a low-complexity scheme that provides data privacy using substantially reduced communication/computational resources relative to the existing secure solution. The key idea behind the suggested scheme is to design the topology of secret-sharing nodes as a sparse random graph instead of the complete graph corresponding to the existing solution. We first obtain the necessary and sufficient condition on the graph to guarantee both reliability and privacy. We then suggest using the Erd\H{o}s-R\'enyi graph in particular and provide theoretical guarantees on the reliability/privacy of the proposed scheme. Through extensive real-world experiments, we demonstrate that our scheme, using only $20 \sim 30\%$ of the resources required in the conventional scheme, maintains virtually the same levels of reliability and data privacy in practical federated learning systems.


title: Composite Adversarial Attacks

abstract: Adversarial attack is a technique for deceiving Machine Learning (ML) models, which provides a way to evaluate the adversarial robustness. In practice, attack algorithms are artificially selected and tuned by human experts to break a ML system. However, manual selection of attackers tends to be sub-optimal, leading to a mistakenly assessment of model security. In this paper, a new procedure called Composite Adversarial Attack (CAA) is proposed for automatically searching the best combination of attack algorithms and their hyper-parameters from a candidate pool of \textbf{32 base attackers}. We design a search space where attack policy is represented as an attacking sequence, i.e., the output of the previous attacker is used as the initialization input for successors. Multi-objective NSGA-II genetic algorithm is adopted for finding the strongest attack policy with minimum complexity. The experimental result shows CAA beats 10 top attackers on 11 diverse defenses with less elapsed time (\textbf{6 $\times$ faster than AutoAttack}), and achieves the new state-of-the-art on $l_{\infty}$, $l_{2}$ and unrestricted adversarial attacks.


title: Optimization-Inspired Learning with Architecture Augmentations and Control Mechanisms for Low-Level Vision

abstract: In recent years, there has been a growing interest in combining learnable modules with numerical optimization to solve low-level vision tasks. However, most existing approaches focus on designing specialized schemes to generate image/feature propagation. There is a lack of unified consideration to construct propagative modules, provide theoretical analysis tools, and design effective learning mechanisms. To mitigate the above issues, this paper proposes a unified optimization-inspired learning framework to aggregate Generative, Discriminative, and Corrective (GDC for short) principles with strong generalization for diverse optimization models. Specifically, by introducing a general energy minimization model and formulating its descent direction from different viewpoints (i.e., in a generative manner, based on the discriminative metric and with optimality-based correction), we construct three propagative modules to effectively solve the optimization models with flexible combinations. We design two control mechanisms that provide the non-trivial theoretical guarantees for both fully- and partially-defined optimization formulations. Under the support of theoretical guarantees, we can introduce diverse architecture augmentation strategies such as normalization and search to ensure stable propagation with convergence and seamlessly integrate the suitable modules into the propagation respectively. Extensive experiments across varied low-level vision tasks validate the efficacy and adaptability of GDC. The codes are available at https://github.com/LiuZhu-CV/GDC-OptimizationLearning


title: An existence result for weakly homogeneous variational inequalities

abstract: In this paper, what we concern about is the weakly homogeneous variational inequality over a finite dimensional real Hilbert space. We achieve an existence result {under} copositivity of leading term of the involved map, norm-coercivity of the natural map and several additional conditions. These conditions we used are easier to check and cross each other with those utilized in the main result established by Gowda and Sossa (Math Program 177:149-171, 2019). As a corollary, we obtain a result on the solvability of nonlinear equations with weakly homogeneous maps involved. Our result enriches the theory for weakly homogeneous variational inequalities and its subcategory problems in the sense that the main result established by Gowda and Sossa covers a majority of existence results on the subcategory problems of weakly homogeneous variational inequalities. Besides, we compare our {existence} result with the well-known coercivity result obtained for general variational inequalities and a norm-coercivity result obtained for general complementarity problems, respectively.


title: Robustness and Stability of Spin Glass Ground States to Perturbed Interactions

abstract: Across many scientific and engineering disciplines, it is important to consider how much the output of a given system changes due to perturbations of the input. Here, we investigate the glassy phase of $\pm J$ spin glasses at zero temperature by calculating the robustness of the ground states to flips in the sign of single interactions. For random graphs and the Sherrington-Kirkpatrick model, we find relatively large sets of bond configurations that generate the same ground state. These sets can themselves be analyzed as subgraphs of the interaction domain, and we compute many of their topological properties. In particular, we find that the robustness, equivalent to the average degree, of these subgraphs is much higher than one would expect from a random model. Most notably, it scales in the same logarithmic way with the size of the subgraph as has been found in genotype-phenotype maps for RNA secondary structure folding, protein quaternary structure, gene regulatory networks, as well as for models for genetic programming. The similarity between these disparate systems suggests that this scaling may have a more universal origin.


title: Developing Motion Code Embedding for Action Recognition in Videos

abstract: In this work, we propose a motion embedding strategy known as motion codes, which is a vectorized representation of motions based on a manipulation's salient mechanical attributes. These motion codes provide a robust motion representation, and they are obtained using a hierarchy of features called the motion taxonomy. We developed and trained a deep neural network model that combines visual and semantic features to identify the features found in our motion taxonomy to embed or annotate videos with motion codes. To demonstrate the potential of motion codes as features for machine learning tasks, we integrated the extracted features from the motion embedding model into the current state-of-the-art action recognition model. The obtained model achieved higher accuracy than the baseline model for the verb classification task on egocentric videos from the EPIC-KITCHENS dataset.


title: Scheduling Beyond CPUs for HPC

abstract: High performance computing (HPC) is undergoing significant changes. The emerging HPC applications comprise both compute- and data-intensive applications. To meet the intense I/O demand from emerging data-intensive applications, burst buffers are deployed in production systems. Existing HPC schedulers are mainly CPU-centric. The extreme heterogeneity of hardware devices, combined with workload changes, forces the schedulers to consider multiple resources (e.g., burst buffers) beyond CPUs, in decision making. In this study, we present a multi-resource scheduling scheme named BBSched that schedules user jobs based on not only their CPU requirements, but also other schedulable resources such as burst buffer. BBSched formulates the scheduling problem into a multi-objective optimization (MOO) problem and rapidly solves the problem using a multi-objective genetic algorithm. The multiple solutions generated by BBSched enables system managers to explore potential tradeoffs among various resources, and therefore obtains better utilization of all the resources. The trace-driven simulations with real system workloads demonstrate that BBSched improves scheduling performance by up to 41% compared to existing methods, indicating that explicitly optimizing multiple resources beyond CPUs is essential for HPC scheduling.