title: Which graphs can be counted in $C_4$-free graphs?

abstract: For which graphs $F$ is there a sparse $F$-counting lemma in $C_4$-free graphs? We are interested in identifying graphs $F$ with the property that, roughly speaking, if $G$ is an $n$-vertex $C_4$-free graph with on the order of $n^{3/2}$ edges, then the density of $F$ in $G$, after a suitable normalization, is approximately at least the density of $F$ in an $\epsilon$-regular approximation of $G$. In recent work, motivated by applications in extremal and additive combinatorics, we showed that $C_5$ has this property. Here we construct a family of graphs with the property.


title: Low-complexity Voronoi shaping for the Gaussian channel

abstract: Voronoi constellations (VCs) are finite sets of vectors of a coding lattice enclosed by the translated Voronoi region of a shaping lattice, which is a sublattice of the coding lattice. In conventional VCs, the shaping lattice is a scaled-up version of the coding lattice. In this paper, we design low-complexity VCs with a cubic coding lattice of up to 32 dimensions, in which pseudo-Gray labeling is applied to minimize the bit error rate. The designed VCs have considerable shaping gains of up to 1.03 dB and finer choices of spectral efficiencies in practice. A mutual information estimation method and a log-likelihood approximation method based on importance sampling for very large constellations are proposed and applied to the designed VCs. With error-control coding, the proposed VCs can have higher achievable information rates than the conventional scaled VCs because of their inherently good pseudo-Gray labeling feature, with a lower decoding complexity.


title: Estimating the number of entities with vacancies using administrative and online data

abstract: In this article we describe a study aimed at estimating job vacancy statistics, in particular the number of entities with at least one vacancy. To achieve this goal, we propose an alternative approach to the methodology exploiting survey data, which is based solely on data from administrative registers and online sources and relies on dual system estimation (DSE). As these sources do not cover the whole reference population and the number of units appearing in all datasets is small, we have developed a DSE approach for negatively dependent sources based on a recent work by Chatterjee and Bhuyan (2020). To achieve the main goal we conducted a thorough data cleaning procedure in order to remove out-of-scope units, identify entities from the target population, and link them by identifiers to minimize linkage errors. We verified the effectiveness and sensitivity of the proposed estimator in simulation studies. From a practical point of view, our results show that the current vacancy survey in Poland underestimates the number of entities with at least one vacancy by about 10-15%. The main reasons for this discrepancy are non-sampling errors due to non-response and under-reporting, which is identified by comparing survey data with administrative data.


title: Database For Studying Edge-on Galaxies

abstract: We present a database created within the project on studying edge-on galaxies. These galaxies provide a unique opportunity to study the three-dimensional distribution of the matter in galaxy disks, which is extremely important for analyzing the influence of internal and external factors on the evolution of galaxies. For the moment, extensive observed material has been accumulated on the kinematics and photometry of such galaxies. The database is designed to organize information, make it easier to visualize, and to improve works on studying this type of objects. The database combines information from previous catalogs on edge-on galaxies and data from current projects; provides access to astrometric and photometric data; carries out interconnection with other databases. The present paper describes the structure and web-access to the database: https://www.sao.ru/edgeon/


title: Convolution with the kernel $e^{s\langle x\rangle^q}, q\geq 1, s>0$ within ultradistribution spaces

abstract: We consider the existence of convolution of Roumieu type ultradistribution with the kernel $e^{s(1+|x|^2)^{q/2}}, q\geq 1$, $s\in\RR\backslash\{0\}$.


title: Weighted Composition Operator and the Mittag-Leffler space

abstract: We present important characterizations of the Weighted Composition Operator over the Mittag Leffler space of entire functions. These characterizations include the Hilbert-Schmidt and Unitary char-acterizations of the Weighted Composition Operator over the Mittag-Leffler space. We also see the result for the spectrum of Weighted com-position operator over the Mittag-Leffler space


title: Understanding lettericity I: a structural hierarchy

abstract: Lettericity is a graph parameter introduced by Petkov\v{s}ek in 2002 in order to study well-quasi-orderability under the induced subgraph relation. In the world of permutations, geometric griddability was independently introduced in 2013 by Albert, Atkinson, Bouvel, Ru\v{s}kuc and Vatter, partly as an enumerative tool. Despite their independent origins, those two notions share a connection: they highlight very similar structural features in their respective objects. The fact that those structural features arose separately on two different occasions makes them very interesting to study in their own right. In the present paper, we explore the notion of lettericity through the lens of "minimal obstructions", i.e., minimal classes of graphs of unbounded lettericity, and identify an infinite collection of such classes. We also discover an intriguing structural hierarchy that arises in the study of lettericity and that of griddability.


title: Method of Alternating Projection for the Absolute Value Equation

abstract: A novel approach for solving the general absolute value equation $Ax+B|x| = c$ where $A,B\in \mathbb{R}^{m\times n}$ and $c\in \mathbb{R}^m$ is presented. We reformulate the equation as a feasibility problem which we solve via the method of alternating projections (MAP). The fixed points set of the alternating projections map is characterized under nondegeneracy conditions on $A$ and $B$. Furthermore, we prove linear convergence of the algorithm. Unlike most of the existing approaches in the literature, the algorithm presented here is capable of handling problems with $m\neq n$, both theoretically and numerically.


title: Itihasa: A large-scale corpus for Sanskrit to English translation

abstract: This work introduces Itihasa, a large-scale translation dataset containing 93,000 pairs of Sanskrit shlokas and their English translations. The shlokas are extracted from two Indian epics viz., The Ramayana and The Mahabharata. We first describe the motivation behind the curation of such a dataset and follow up with empirical analysis to bring out its nuances. We then benchmark the performance of standard translation models on this corpus and show that even state-of-the-art transformer architectures perform poorly, emphasizing the complexity of the dataset.


title: Meta-learning for downstream aware and agnostic pretraining

abstract: Neural network pretraining is gaining attention due to its outstanding performance in natural language processing applications. However, pretraining usually leverages predefined task sequences to learn general linguistic clues. The lack of mechanisms in choosing proper tasks during pretraining makes the learning and knowledge encoding inefficient. We thus propose using meta-learning to select tasks that provide the most informative learning signals in each episode of pretraining. With the proposed method, we aim to achieve better efficiency in computation and memory usage for the pretraining process and resulting networks while maintaining the performance. In this preliminary work, we discuss the algorithm of the method and its two variants, downstream-aware and downstream-agnostic pretraining. Our experiment plan is also summarized, while empirical results will be shared in our future works.


title: Fixing Vulnerabilities Potentially Hinders Maintainability

abstract: Security is a requirement of utmost importance to produce high-quality software. However, there is still a considerable amount of vulnerabilities being discovered and fixed almost weekly. We hypothesize that developers affect the maintainability of their codebases when patching vulnerabilities. This paper evaluates the impact of patches to improve security on the maintainability of open-source software. Maintainability is measured based on the Better Code Hub's model of 10 guidelines on a dataset, including 1300 security-related commits. Results show evidence of a trade-off between security and maintainability for 41.90% of the cases, i.e., developers may hinder software maintainability. Our analysis shows that 38.29% of patches increased software complexity and 37.87% of patches increased the percentage of LOCs per unit. The implications of our study are that changes to codebases while patching vulnerabilities need to be performed with extra care; tools for patch risk assessment should be integrated into the CI/CD pipeline; computer science curricula needs to be updated; and, more secure programming languages are necessary.


title: Signatured Deep Fictitious Play for Mean Field Games with Common Noise

abstract: Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise.


title: Control-Oriented Model-Based Reinforcement Learning with Implicit Differentiation

abstract: The shortcomings of maximum likelihood estimation in the context of model-based reinforcement learning have been highlighted by an increasing number of papers. When the model class is misspecified or has a limited representational capacity, model parameters with high likelihood might not necessarily result in high performance of the agent on a downstream control task. To alleviate this problem, we propose an end-to-end approach for model learning which directly optimizes the expected returns using implicit differentiation. We treat a value function that satisfies the Bellman optimality operator induced by the model as an implicit function of model parameters and show how to differentiate the function. We provide theoretical and empirical evidence highlighting the benefits of our approach in the model misspecification regime compared to likelihood-based methods.


title: The Magellanic Edges Survey -- II. Formation of the LMC's northern arm

abstract: The highly-substructured outskirts of the Magellanic Clouds provide ideal locations for studying the complex interaction history between both Clouds and the Milky Way (MW). In this paper, we investigate the origin of a >20$^\circ$ long arm-like feature in the northern outskirts of the Large Magellanic Cloud (LMC) using data from the Magellanic Edges Survey (MagES) and Gaia EDR3. We find that the arm has a similar geometry and metallicity to the nearby outer LMC disk, indicating that it is comprised of perturbed disk material. Whilst the azimuthal velocity and velocity dispersions along the arm are consistent with those in the outer LMC, the in-plane radial velocity and out-of-plane vertical velocity are significantly perturbed from equilibrium disk kinematics. We compare these observations to a new suite of dynamical models of the Magellanic/MW system, which describe the LMC as a collection of tracer particles within a rigid potential, and the SMC as a rigid Hernquist potential. Our models indicate the tidal force of the MW during the LMC's infall is likely responsible for the observed increasing out-of-plane velocity along the arm. Our models also suggest close LMC/SMC interactions within the past Gyr, particularly the SMC's pericentric passage ~150 Myr ago and a possible SMC crossing of the LMC disk plane ~400 Myr ago, likely do not perturb stars that today comprise the arm. Historical interactions with the SMC prior to ~1 Gyr ago may be required to explain some of the observed kinematic properties of the arm, in particular its strongly negative in-plane radial velocity.


title: What if we Increase the Number of Objectives? Theoretical and Empirical Implications for Many-objective Optimization

abstract: The difficulty of solving a multi-objective optimization problem is impacted by the number of objectives to be optimized. The presence of many objectives typically introduces a number of challenges that affect the choice/design of optimization algorithms. This paper investigates the drivers of these challenges from two angles: (i) the influence of the number of objectives on problem characteristics and (ii) the practical behavior of commonly used procedures and algorithms for coping with many objectives. In addition to reviewing various drivers, the paper makes theoretical contributions by quantifying some drivers and/or verifying these drivers empirically by carrying out experiments on multi-objective NK landscapes and other typical benchmarks. We then make use of our theoretical and empirical findings to derive practical recommendations to support algorithm design. Finally, we discuss remaining theoretical gaps and opportunities for future research in the area of multi- and many-objective optimization.


title: Stochastic filtering for multiscale stochastic reaction networks based on hybrid approximations

abstract: In the past few decades, the development of fluorescent technologies and microscopic techniques has greatly improved scientists' ability to observe real-time single-cell activities. In this paper, we consider the filtering problem associate with these advanced technologies, i.e., how to estimate latent dynamic states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. A good solution to this problem can further improve scientists' ability to extract information about intracellular systems from time-course experiments. A straightforward approach to this filtering problem is to use a particle filter where particles are generated by simulation of the full model and weighted according to observations. However, the exact simulation of the full dynamic model usually takes an impractical amount of computational time and prevents this type of particle filters from being used for real-time applications, such as transcription regulation networks. Inspired by the recent development of hybrid approximations to multiscale chemical reaction networks, we approach the filtering problem in an alternative way. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exploiting the time-scale separations in the original network and, therefore, can greatly reduce the computational effort required to simulate the dynamics. As a result, we are able to develop efficient particle filters to solve the filtering problem for the original model by applying particle filters to the reduced model. We illustrate the accuracy and the computational efficiency of our approach using several numerical examples.


title: Transposed Hom-Poisson and Hom-pre-Lie Poisson algebras and bialgebras

abstract: The notions of transposed Hom-Poisson and Hom-pre-Lie Poisson algebras are introduced. Their bimodules and matched pairs are defined and the relevant properties and theorems are given. The notion of Manin triple of transposed Hom-Poisson algebras is introduced, and its equivalence to the transposed Hom-Poisson bialgebras is investigated. The notion of $\mathcal{O}$-operator is exploited to illustrate the relations existing between transposed Hom-Poisson and Hom-pre-Lie Poisson algebras.


title: Coordinating Followers to Reach Better Equilibria: End-to-End Gradient Descent for Stackelberg Games

abstract: A growing body of work in game theory extends the traditional Stackelberg game to settings with one leader and multiple followers who play a Nash equilibrium. Standard approaches for computing equilibria in these games reformulate the followers' best response as constraints in the leader's optimization problem. These reformulation approaches can sometimes be effective, but often get trapped in low-quality solutions when followers' objectives are non-linear or non-quadratic. Moreover, these approaches assume a unique equilibrium or a specific equilibrium concept, e.g., optimistic or pessimistic, which is a limiting assumption in many situations. To overcome these limitations, we propose a stochastic gradient descent--based approach, where the leader's strategy is updated by differentiating through the followers' best responses. We frame the leader's optimization as a learning problem against followers' equilibrium, which allows us to decouple the followers' equilibrium constraints from the leader's problem. This approach also addresses cases with multiple equilibria and arbitrary equilibrium selection procedures by back-propagating through a sampled Nash equilibrium. To this end, this paper introduces a novel concept called equilibrium flow to formally characterize the set of equilibrium selection processes where the gradient with respect to a sampled equilibrium is an unbiased estimate of the true gradient. We evaluate our approach experimentally against existing baselines in three Stackelberg problems with multiple followers and find that in each case, our approach is able to achieve higher utility for the leader.


title: Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning

abstract: In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes decision quality when the optimization is subsequently solved. Recent work on decision-focused learning shows that embedding the optimization problem in the training pipeline can improve decision quality and help generalize better to unseen tasks compared to relying on an intermediate loss function for evaluating prediction quality. We study the predict-then-optimize framework in the context of sequential decision problems (formulated as MDPs) that are solved via reinforcement learning. In particular, we are given environment features and a set of trajectories from training MDPs, which we use to train a predictive model that generalizes to unseen test MDPs without trajectories. Two significant computational challenges arise in applying decision-focused learning to MDPs: (i) large state and action spaces make it infeasible for existing techniques to differentiate through MDP problems, and (ii) the high-dimensional policy space, as parameterized by a neural network, makes differentiating through a policy expensive. We resolve the first challenge by sampling provably unbiased derivatives to approximate and differentiate through optimality conditions, and the second challenge by using a low-rank approximation to the high-dimensional sample-based derivatives. We implement both Bellman--based and policy gradient--based decision-focused learning on three different MDP problems with missing parameters, and show that decision-focused learning performs better in generalization to unseen tasks.


title: Semiclassical trajectories in the double-slit experiment

abstract: We provide a semiclassical description of the double-slit experiment based on momentous quantum mechanics, where the implementation of canonical variables facilitate the derivation of the equations of motion for the system. We show the evolution of individual particles and their semiclassical trajectories, collectively reproduce the well-known quantum interference pattern. It is found that the non-crossing rule for trajectories, present in Bohmian mechanics, is not required under our treatment. We are able to follow classical configuration variables from this semiclassical scheme, and discuss substantial differences between our description and the Bohmian perspective


title: Airplane Orbits and Satellite Orbits and Orbitfall: Physics Hidden in Plain Sight

abstract: An airplane flying at constant speed and altitude is an example of physics invisible to the pilots and passengers, but visible to remote observers and manifest in the mathematics. The optimum flight path is an arc of a Great Circle, specifically that circle which is the result of rotating the equator to intersect the origin and destination airports. In order that the velocity vector remain parallel to the surface of the spherical earth, a centripetal force is required to rotate the velocity without altering its magnitude. This force must be radially inward and thus parallel to the local vertical. The assertion that ``lift balances gravity" is only an approximation. To follow the curve of the earth, the vertical component of aerodynamic lift must be \emph{slightly weaker} than gravity so that the plane can be in ``orbitfall". That is, to follow the curvature of the earth, maintaining a constant distance $R$ from the center of the earth while flying at a constant speed $V$ and generating a vertical lift per unit mass $L$, the plane and all inside it must fall towards the center of the earth with an acceleration, the ``orbitfall acceleration", $g_{orbitfall} \equiv g-L=V^{2} / R$ where $g$ is the usual gravitational acceleration constant. If the plane travels a fraction $\digamma$ of the earth's circumference , then it must execute $\digamma$ of an outside loop. This requires that the pitch angle $\xi$ must rotate nose-down at a rate of $d \xi / dt=V/R$. The dynamic stability of a non-military aircraft makes this pitch change continuously without pilot intervention: the horizontal stabilizers act as weathervanes, suppressing small perturbations so that the longitudinal axis remains at a constant angle of attack. Neither pilot nor passenger is aware of the orbitfall or the automatic pitch changes -- physics invisible but essential.


title: Data-Driven Adaptive Network Slicing for Multi-Tenant Networks

abstract: Network slicing to support multi-tenancy plays a key role in improving the performance of 5G networks. In this paper, we propose a two time-scale framework for the reservation-based network slicing in the backhaul and Radio Access Network (RAN). In the proposed two time-scale scheme, a subset of network slices is activated via a novel sparse optimization framework in the long time-scale with the goal of maximizing the expected utilities of tenants while in the short time-scale the activated slices are reconfigured according to the time-varying user traffic and channel states. Specifically, using the statistics from users and channels and also considering the expected utility from serving users of a slice and the reconfiguration cost, we formulate a sparse optimization problem to update the configuration of a slice resources such that the maximum isolation of reserved resources is enforced. The formulated optimization problems for long and short time-scales are non-convex and difficult to solve. We use the $\ell_q$-norm, $0<q<1$, and group LASSO regularizations to iteratively find convex approximations of the optimization problems. We propose a Frank-Wolfe algorithm to iteratively solve approximated problems in long time-scales. To cope with the dynamical nature of traffic variations, we propose a fast, distributed algorithm to solve the approximated optimization problems in short time-scales. Simulation results demonstrate the performance of our approaches relative to optimal solutions and the existing state of the art method.


title: Video Imprint

abstract: A new unified video analytics framework (ER3) is proposed for complex event retrieval, recognition and recounting, based on the proposed video imprint representation, which exploits temporal correlations among image features across video frames. With the video imprint representation, it is convenient to reverse map back to both temporal and spatial locations in video frames, allowing for both key frame identification and key areas localization within each frame. In the proposed framework, a dedicated feature alignment module is incorporated for redundancy removal across frames to produce the tensor representation, i.e., the video imprint. Subsequently, the video imprint is individually fed into both a reasoning network and a feature aggregation module, for event recognition/recounting and event retrieval tasks, respectively. Thanks to its attention mechanism inspired by the memory networks used in language modeling, the proposed reasoning network is capable of simultaneous event category recognition and localization of the key pieces of evidence for event recounting. In addition, the latent structure in our reasoning network highlights the areas of the video imprint, which can be directly used for event recounting. With the event retrieval task, the compact video representation aggregated from the video imprint contributes to better retrieval results than existing state-of-the-art methods.


title: Exactly solvable discrete time Birth and Death processes

abstract: We present 15 explicit examples of discrete time Birth and Death processes which are exactly solvable. They are related to the hypergeometric orthogonal polynomials of Askey scheme having discrete orthogonality measures. Namely, they are the Krawtchouk, three different kinds of q-Krawtchouk, (dual, q)-Hahn, (q)-Racah, Al-Salam-Carlitz II, q-Meixner, q-Charlier, dual big q-Jacobi and dual big q-Laguerre polynomials. The birth and death rates are determined by the difference equations governing the polynomials. The stationary distributions are the normalised orthogonality measures of the polynomials. The transition probabilities are neatly expressed by the normalised polynomials and the corresponding eigenvalues. This paper is simply the discrete time versions of the known solutions of the continuous time birth and death processes.


title: A sparse $p_0$ model with covariates for directed networks

abstract: We are concerned here with unrestricted maximum likelihood estimation in a sparse $p_0$ model with covariates for directed networks. The model has a density parameter $\nu$, a $2n$-dimensional node parameter $\bs{\eta}$ and a fixed dimensional regression coefficient $\bs{\gamma}$ of covariates. Previous studies focus on the restricted likelihood inference. When the number of nodes $n$ goes to infinity, we derive the $\ell_\infty$-error between the maximum likelihood estimator (MLE) $(\widehat{\bs{\eta}}, \widehat{\bs{\gamma}})$ and its true value $(\bs{\eta}, \bs{\gamma})$. They are $O_p( (\log n/n)^{1/2} )$ for $\widehat{\bs{\eta}}$ and $O_p( \log n/n)$ for $\widehat{\bs{\gamma}}$, up to an additional factor. This explains the asymptotic bias phenomenon in the asymptotic normality of $\widehat{\bs{\gamma}}$ in \cite{Yan-Jiang-Fienberg-Leng2018}. Further, we derive the asymptotic normality of the MLE. Numerical studies and a data analysis demonstrate our theoretical findings.


title: Early Science with the Large Millimeter Telescope: a 1.1 mm AzTEC Survey of Red-$Herschel$ dusty star-forming galaxies

abstract: We present LMT/AzTEC 1.1mm observations of $\sim100$ luminous high-redshift dusty star-forming galaxy candidates from the $\sim600\,$sq.deg $Herschel$-ATLAS survey, selected on the basis of their SPIRE red far-infrared colours and with $S_{500\mu\rm m}=35-80$ mJy. With an effective $\theta_{\rm FWHM}\approx9.5\,$ arcsec angular resolution, our observations reveal that at least 9 per cent of the targets break into multiple systems with SNR $\geq 4$ members. The fraction of multiple systems increases to $\sim23\,$ per cent (or more) if some non-detected targets are considered multiples, as suggested by the data. Combining the new AzTEC and deblended $Herschel$ photometry we derive photometric redshifts, IR luminosities, and star formation rates. While the median redshifts of the multiple and single systems are similar $(z_{\rm med}\approx3.6)$, the redshift distribution of the latter is skewed towards higher redshifts. Of the AzTEC sources $\sim85\,$ per cent lie at $z_{\rm phot}>3$ while $\sim33\,$ per cent are at $z_{\rm phot}>4$. This corresponds to a lower limit on the space density of ultra-red sources at $4<z<6$ of $\sim3\times10^{-7}\, \textrm{Mpc}^{-3}$ with a contribution to the obscured star-formation of $\gtrsim 8\times10^{-4}\, \textrm{M}_\odot \textrm{yr}^{-1} \textrm{Mpc}^{-3}$. Some of the multiple systems have members with photometric redshifts consistent among them suggesting possible physical associations. Given their angular separations, these systems are most likely galaxy over-densities and/or early-stage pre-coalescence mergers. Finally, we present 3mm LMT/RSR spectroscopic redshifts of six red-$Herschel$ galaxies at $z_{\rm spec}=3.85-6.03$, two of them (at $z \sim 4.7$) representing new redshift confirmations. Here we release the AzTEC and deblended $Herschel$ photometry as well as catalogues of the most promising interacting systems and $z>4$ galaxies.


title: Stein ICP for Uncertainty Estimation in Point Cloud Matching

abstract: Quantification of uncertainty in point cloud matching is critical in many tasks such as pose estimation, sensor fusion, and grasping. Iterative closest point (ICP) is a commonly used pose estimation algorithm which provides a point estimate of the transformation between two point clouds. There are many sources of uncertainty in this process that may arise due to sensor noise, ambiguous environment, and occlusion. However, for safety critical problems such as autonomous driving, a point estimate of the pose transformation is not sufficient as it does not provide information about the multiple solutions. Current probabilistic ICP methods usually do not capture all sources of uncertainty and may provide unreliable transformation estimates which can have a detrimental effect in state estimation or decision making tasks that use this information. In this work we propose a new algorithm to align two point clouds that can precisely estimate the uncertainty of ICP's transformation parameters. We develop a Stein variational inference framework with gradient based optimization of ICP's cost function. The method provides a non-parametric estimate of the transformation, can model complex multi-modal distributions, and can be effectively parallelized on a GPU. Experiments using 3D kinect data as well as sparse indoor/outdoor LiDAR data show that our method is capable of efficiently producing accurate pose uncertainty estimates.


title: Quivers and moduli of their thin sincere representations in Macaulay2

abstract: We introduce the Macaulay2 package ThinSincereQuivers for studying acyclic quivers, the moduli of their thin-sincere representations, and the reflexive flow polytopes associated to them. We provide some background on the topic and illustrate how the package recovers examples from the literature.


title: Bosons on a rotating ring with free boundary conditions

abstract: We consider a system of interacting non-relativistic bosons confined to a one-dimensional ring in the presence of a synthetic gauge field induced by a rotating barrier. Interactions are introduced as a constraint in field space, and the barrier is modeled by general boundary conditions. Within this setup, we compute the effective action and investigate the profile of the ground state and its sensitivity from rotational velocity and the properties of the barrier.


title: FACT: A Full-body Ad-hoc Collaboration Testbed for Modeling Complex Teamwork

abstract: Robots are envisioned to work alongside humans in applications ranging from in-home assistance to collaborative manufacturing. Research on human-robot collaboration (HRC) has helped develop various aspects of social intelligence necessary for robots to participate in effective, fluid collaborations with humans. However, HRC research has focused on dyadic, structured, and minimal collaborations between humans and robots that may not fully represent the large scale and emergent nature of more complex, unstructured collaborative activities. Thus, there remains a need for shared testbeds, datasets, and evaluation metrics that researchers can use to better model natural, ad-hoc human collaborative behaviors and develop robot capabilities intended for large scale emergent collaborations. We present one such shared resource - FACT (Full-body Ad-hoc Collaboration Testbed), an openly accessible testbed for researchers to obtain an expansive view of the individual and team-based behaviors involved in complex, co-located teamwork. We detail observations from a preliminary exploration with teams of various sizes and discuss potential research questions that may be investigated using the testbed. Our goal is for FACT to be an initial resource that supports a more holistic investigation of human-robot collaboration.


title: Robust transitivity and domination for endomorphisms displaying critical points

abstract: We show that robustly transitive endomorphisms of a closed manifolds must have a non-trivial dominated splitting or be a local diffeomorphism. This allows to get some topological obstructions for the existence of robustly transitive endomorphisms. To obtain the result we must understand the structure of the kernel of the differential and the recurrence to the critical set of the endomorphism after perturbation.


title: High-mobility two-dimensional carriers from surface Fermi arcs in magnetic Weyl semimetal films

abstract: High-mobility two-dimensional carriers originating from surface Fermi arcs in magnetic Weyl semimetals are highly desired for accessing exotic quantum transport phenomena and for topological electronics applications. Here, we demonstrate high-mobility two-dimensional carriers that show quantum oscillations in magnetic Weyl semimetal SrRuO3 epitaxial films by systematic angle-dependent, high-magnetic field magnetotransport experiments. The exceptionally high-quality SrRuO3 films were grown by state-of-the-art oxide thin film growth technologies driven by machine learning algorithm. The quantum oscillations for the 10-nm SrRuO3 film show a high quantum mobility of 3500 cm2/Vs, a light cyclotron mass, and two-dimensional angular dependence, which can be attributed to the surface Fermi arcs. The linear thickness dependence of the phase shift of the quantum oscillations provides evidence for the non-trivial nature of the quantum oscillations mediated by the surface Fermi arcs. In addition, at low temperatures and under magnetic fields of up to 52 T, the quantum limit of SrRuO3 manifests the chiral anomaly of the Weyl nodes. Emergence of the hitherto hidden two-dimensional Weyl states in a ferromagnetic oxide pave the way to explore novel quantum transport phenomena for topological oxide electronics.


title: Enhancement of ablative Rayleigh-Taylor instability growth by thermal conduction suppression in a magnetic field

abstract: Ablative Rayleigh-Taylor instability growth was investigated to elucidate the fundamental physics of thermal conduction suppression in a magnetic field. Experiments found that unstable modulation growth is faster in an external magnetic field. This result was reproduced by a magnetohydrodynamic simulation based on a Braginskii model of electron thermal transport. An external magnetic field reduces the electron thermal conduction across the magnetic field lines because the Larmor radius of the thermal electrons in the field is much shorter than the temperature scale length. Thermal conduction suppression leads to spatially nonuniform pressure and reduced thermal ablative stabilization, which in turn increases the growth of ablative Rayleigh-Taylor instability.


title: Can small-scale magnetic fields be the major cause for the near-surface effect of the solar p-mode frequencies?

abstract: Small-scale magnetic fields are not only the fundamental element of the solar magnetism, but also closely related to the structure of the solar atmosphere. The observations have shown that there is a ubiquitous tangled small-scale magnetic field with a strength of 60 $\sim$ 130\,G in the canopy forming layer of the quiet solar photosphere. On the other hand, the multi-dimensional MHD simulations show that the convective overshooting expels the magnetic field to form the magnetic canopies at a height of about 500\,km in the upper photosphere. However, the distribution of such small-scale ``canopies" in the solar photosphere cannot be rigorously constrained by either observations and numerical simulations. Based on stellar standard models, we identify that these magnetic canopies can act as a global magnetic-arch splicing layer, and find that the reflections of the solar p-mode oscillations at this magnetic-arch splicing layer results in significant improvement on the discrepancy between the observed and calculated p-mode frequencies. The location of the magnetic-arch splicing layer is determined at a height of about 630\,km, and the inferred strength of the magnetic field is about 90\,G. These features of the magnetic-arch splicing layer derived independently in the present study are quantitatively in agreement with the presence of small-scale magnetic canopies as those obtained by the observations and 3-D MHD simulations.


title: A note on extrapolation of compactness

abstract: This note is devoted to the study of Hyt\"{o}nen's extrapolation theorem of compactness on weighted Lebesgue spaces. Two criteria of compactness of linear operators in the two-weight setting are obtained. As applications, we obtain two-weight compactness of commutators of Calder\'{o}n--Zygmund operators, fractional integrals and bilinear Calder\'{o}n--Zygmund operators.


title: Doping-dependent metal-insulator transition in a disordered Hubbard model

abstract: We study the effect of disorder and doping on the metal-insulator transition in a repulsive Hubbard model on a square lattice using the determinant quantum Monte Carlo method. First, with the aim of making our results reliable, we compute the sign problem with various parameters such as temperature, disorder, on-site interactions, and lattice size. We show that in the presence of randomness in the hopping elements, the metal-insulator transition occurs and the critical disorder strength differs at different fillings. We also demonstrate that doping is a driving force behind the metal-insulator transition.


title: On the Language Coverage Bias for Neural Machine Translation

abstract: Language coverage bias, which indicates the content-dependent differences between sentence pairs originating from the source and target languages, is important for neural machine translation (NMT) because the target-original training data is not well exploited in current practice. By carefully designing experiments, we provide comprehensive analyses of the language coverage bias in the training data, and find that using only the source-original data achieves comparable performance with using full training data. Based on these observations, we further propose two simple and effective approaches to alleviate the language coverage bias problem through explicitly distinguishing between the source- and target-original training data, which consistently improve the performance over strong baselines on six WMT20 translation tasks. Complementary to the translationese effect, language coverage bias provides another explanation for the performance drop caused by back-translation. We also apply our approach to both back- and forward-translation and find that mitigating the language coverage bias can improve the performance of both the two representative data augmentation methods and their tagged variants.


title: A linear relation between galaxy-lensing cross-correlations to test the cosmological principle model-independently

abstract: We discover a linear relation between two sets of galaxy-lensing cross-correlations. This linear relation holds, as long as light follows the geodesic and the metric is Friedmann-Lema\^{i}tre-Robertson-Walker (FLRW). Violation of the cosmological principle (and equivalently the FLRW metric) will break this linear relation. Therefore it provides a powerful test of the cosmological principle, based on direct observables and relied on no specific cosmological models. We demonstrate that stage IV galaxy surveys and CMB-S4 experiments will be able to test this linear relation stringently and therefore test the cosmological principle robustly.


title: Video Instance Segmentation using Inter-Frame Communication Transformers

abstract: We propose a novel end-to-end solution for video instance segmentation (VIS) based on transformers. Recently, the per-clip pipeline shows superior performance over per-frame methods leveraging richer information from multiple frames. However, previous per-clip models require heavy computation and memory usage to achieve frame-to-frame communications, limiting practicality. In this work, we propose Inter-frame Communication Transformers (IFC), which significantly reduces the overhead for information-passing between frames by efficiently encoding the context within the input clip. Specifically, we propose to utilize concise memory tokens as a mean of conveying information as well as summarizing each frame scene. The features of each frame are enriched and correlated with other frames through exchange of information between the precisely encoded memory tokens. We validate our method on the latest benchmark sets and achieved the state-of-the-art performance (AP 44.6 on YouTube-VIS 2019 val set using the offline inference) while having a considerably fast runtime (89.4 FPS). Our method can also be applied to near-online inference for processing a video in real-time with only a small delay. The code will be made available.


title: Sum of Ranked Range Loss for Supervised Learning

abstract: In forming learning objectives, one oftentimes needs to aggregate a set of individual values to a single output. Such cases occur in the aggregate loss, which combines individual losses of a learning model over each training sample, and in the individual loss for multi-label learning, which combines prediction scores over all class labels. In this work, we introduce the sum of ranked range (SoRR) as a general approach to form learning objectives. A ranked range is a consecutive sequence of sorted values of a set of real numbers. The minimization of SoRR is solved with the difference of convex algorithm (DCA). We explore two applications in machine learning of the minimization of the SoRR framework, namely the AoRR aggregate loss for binary/multi-class classification at the sample level and the TKML individual loss for multi-label/multi-class classification at the label level. A combination loss of AoRR and TKML is proposed as a new learning objective for improving the robustness of multi-label learning in the face of outliers in sample and labels alike. Our empirical results highlight the effectiveness of the proposed optimization frameworks and demonstrate the applicability of proposed losses using synthetic and real data sets.


title: Reply to arXiv:2103.10268 `Comment on "Crossover of Charge Fluctuations across the Strange Metal Phase Diagram'''

abstract: We recently reported [1,2] measurements of the charge density fluctuations in the strange metal cuprate Bi$_{2.1}$Sr$_{1.9}$Ca$_{1.0}$Cu$_{2.0}$O$_{8+x}$ using both reflection M-EELS and transmission EELS with $\leq$10 meV energy resolution. We observed the well-known 1 eV plasmon in this material for momentum $q\lesssim$ 0.12 r.l.u., but found that it does not persist to large $q$. For $q\gtrsim0.12$ r.l.u., we observe a frequency-independent continuum, similar to that observed in early Raman scattering experiments [3,4], that correlates highly with the strange metal phase [2]. In his Comment (arXiv:2103.10268), Joerg Fink claims we do not see the plasmon, and that our results are inconsistent with optics, RIXS, and the author's own transmission EELS measurements with $\sim$100 meV resolution from the early 1990's [5,6]. The author claims we have made a trigonometry error and are measuring a larger momentum than we think. The author asserts that the two-particle excitations of cuprate strange metals are accurately described by weakly interacting band theory in RPA with corrections for conduction band carrier lifetimes and Umklapp effects. Here, we show that the author's Comment is in contradiction with known information from the literature. At $q\lesssim0.12$ r.l.u. we see the same 1 eV plasmon as other techniques. Moreover we compute our momentum correctly, adjusting the sample and detector angles during an energy scan to keep $q$ fixed. The only discrepancy is between our data and the results of Ref. [5] for $q\gtrsim0.12$ r.l.u. where, because of the coarse resolution used, the data had to be corrected for interference from the elastic line. A reexamination of these corrections in early transmission EELS measurements would likely shed light on this discrepancy.


title: Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

abstract: In a modern distributed storage system, storage nodes are organized in racks, and the cross-rack communication dominates the system bandwidth. In We study the rack-aware storage system where all storage nodes are organized in racks and within each rack the nodes can communicate freely without taxing the system bandwidth. Rack-aware regenerating codes (RRCs) were proposed for minimizing the repair bandwidth for single erasures. In the initial setting of RRCs, the repair of a single node requires the participation of all the remaining nodes in the rack containing the failed node as well as a large number of helper racks containing no failures. Consequently, the repair may be infeasible in front of multiple node failures. In this work, a relaxed repair model that can tolerate multiple node failures by simultaneously reducing the intra-rack connections and cross-rack connections is proposed. A tradeoff between the storage and repair bandwidth under the relaxed repair model is derived, and parameters of the two extreme points on the tradeoff curve are characterized for the minimum storage and minimum bandwidth respectively. Moreover, two codes corresponding to the extreme points are explicitly constructed over the fields of size comparable to the code length and with the lowest sub-packetization. Finally, for the convenience of practical use, systematic encoding processes for the two codes are also established.


title: Coherent epitaxy of trilayer nickelate (Nd0.8Sr0.2)4Ni3O10 films by high-pressure magnetron sputtering

abstract: Rare-earth (R) nickelates (such as perovskite RNiO3, trilayer R4Ni3O10, and infinite layer RNiO2) have attracted tremendous interest very recently. However, unlike widely studied RNiO3 and RNiO2 films, the synthesis of trilayer nickelate R4Ni3O10 films is rarely reported. Here, single-crystalline (Nd0.8Sr0.2)4Ni3O10 epitaxial films were coherently grown on SrTiO3 substrates by high-pressure magnetron sputtering. The crystal and electronic structures of (Nd0.8Sr0.2)4Ni3O10 films were characterized by high-resolution X-ray diffraction and X-ray photoemission spectroscopy, respectively. The electrical transport measurements reveal a metal-insulator transition near 82 K and negative magnetoresistance in (Nd0.8Sr0.2)4Ni3O10 films. Our work provides a novel route to synthesize high-quality trilayer nickelate R4Ni3O10 films.


title: Packaged Software Implementation Requirements Engineering by Small Software Enterprises

abstract: Small to medium sized business enterprises (SMEs) generally thrive because they have successfully done something unique within a niche market. For this reason, SMEs may seek to protect their competitive advantage by avoiding any standardization encouraged by the use of packaged software (PS). Packaged software implementation at SMEs therefore presents challenges relating to how best to respond to misfits between the functionality offered by the packaged software and each SME's business needs. An important question relates to which processes small software enterprises - or Small to Medium-Sized Software Development Companies (SMSSDCs) - apply in order to identify and then deal with these misfits. To explore the processes of packaged software (PS) implementation, an ethnographic study was conducted to gain in-depth insights into the roles played by analysts in two SMSSDCs. The purpose of the study was to understand PS implementation in terms of requirements engineering (or 'PSIRE'). Data collected during the ethnographic study were analyzed using an inductive approach. Based on our analysis of the cases we constructed a theoretical model explaining the requirements engineering process for PS implementation, and named it the PSIRE Parallel Star Model. The Parallel Star Model shows that during PSIRE, more than one RE process can be carried out at the same time. The Parallel Star Model has few constraints, because not only can processes be carried out in parallel, but they do not always have to be followed in a particular order. This paper therefore offers a novel investigation and explanation of RE practices for packaged software implementation, approaching the phenomenon from the viewpoint of the analysts, and offers the first extensive study of packaged software implementation RE (PSIRE) in SMSSDCs.


title: Faster Cut-Equivalent Trees in Simple Graphs

abstract: Let $G = (V, E)$ be an undirected connected simple graph on $n$ vertices. A cut-equivalent tree of $G$ is an edge-weighted tree on the same vertex set $V$, such that for any pair of vertices $s, t\in V$, the minimum $(s, t)$-cut in the tree is also a minimum $(s, t)$-cut in $G$, and these two cuts have the same cut value. In a recent paper [Abboud, Krauthgamer and Trabelsi, 2021], the authors propose the first subcubic time algorithm for constructing a cut-equivalent tree. More specifically, their algorithm has $\widetilde{O}(n^{2.5})$ running time. In this paper, we improve the running time to $\hat{O}(n^2)$ if almost-linear time max-flow algorithms exist. Also, using the currently fastest max-flow algorithm by [van den Brand et al, 2021], our algorithm runs in time $\widetilde{O}(n^{17/8})$.


title: HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections

abstract: This paper studies Principal Component Analysis (PCA) for data lying in hyperbolic spaces. Given directions, PCA relies on: (1) a parameterization of subspaces spanned by these directions, (2) a method of projection onto subspaces that preserves information in these directions, and (3) an objective to optimize, namely the variance explained by projections. We generalize each of these concepts to the hyperbolic space and propose HoroPCA, a method for hyperbolic dimensionality reduction. By focusing on the core problem of extracting principal directions, HoroPCA theoretically better preserves information in the original data such as distances, compared to previous generalizations of PCA. Empirically, we validate that HoroPCA outperforms existing dimensionality reduction methods, significantly reducing error in distance preservation. As a data whitening method, it improves downstream classification by up to 3.9% compared to methods that don't use whitening. Finally, we show that HoroPCA can be used to visualize hyperbolic data in two dimensions.


title: Terrain Adaptive Gait Transitioning for a Quadruped Robot using Model Predictive Control

abstract: Legged robots can traverse challenging terrain, use perception to plan their safe foothold positions, and navigate the environment. Such unique mobility capabilities make these platforms a perfect candidate for scenarios such as search and rescue, inspection, and exploration tasks. While traversing through such terrains, the robot's instability is a significant concern. Many times the robot needs to switch gaits depending on its environment. Due to the complex dynamics of quadruped robots, classical PID control fails to provide high stability. Thus, there is a need for advanced control methods like the Model Predictive Control (MPC) which uses the system model and the nature of the terrain in order to predict the stable body pose of the robot. The controller also provides correction to any external disturbances that result in a change in the desired behavior of the robot. The MPC controller is designed in MATLAB, for full body torque control. The controller performance was verified on Boston Dynamics Spot in Webots simulator. The robot is able to provide correction for external perturbations up to 150 N and also resist falls till 80 cm.


title: A new gradient estimate for the complex Monge-Amp\`ere equation

abstract: A gradient estimate for complex Monge-Amp\`ere equations which improves in some respects on known estimates is proved using the ABP maximum principle.


title: Adopting Softer Approaches in the Study of Repository Data: A Comparative Analysis

abstract: Context: Given the acknowledged need to understand the people processes enacted during software development, software repositories and mailing lists have become a focus for many studies. However, researchers have tended to use mostly mathematical and frequency-based techniques to examine the software artifacts contained within them. Objective: There is growing recognition that these approaches uncover only a partial picture of what happens during software projects, and deeper contextual approaches may provide further understanding of the intricate nature of software teams' dynamics. We demonstrate the relevance and utility of such approaches in this study. Method: We use psycholinguistics and directed content analysis (CA) to study the way project tasks drive teams' attitudes and knowledge sharing. We compare the outcomes of these two approaches and offer methodological advice for researchers using similar forms of repository data. Results: Our analysis reveals significant differences in the way teams work given their portfolio of tasks and the distribution of roles. Conclusion: We overcome the limitations associated with employing purely quantitative approaches, while avoiding the time-intensive and potentially invasive nature of field work required in full case studies.


title: Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model

abstract: Knowledge distillation (KD) is a successful approach for deep neural network acceleration, with which a compact network (student) is trained by mimicking the softmax output of a pre-trained high-capacity network (teacher). In tradition, KD usually relies on access to the training samples and the parameters of the white-box teacher to acquire the transferred knowledge. However, these prerequisites are not always realistic due to storage costs or privacy issues in real-world applications. Here we propose the concept of decision-based black-box (DB3) knowledge distillation, with which the student is trained by distilling the knowledge from a black-box teacher (parameters are not accessible) that only returns classes rather than softmax outputs. We start with the scenario when the training set is accessible. We represent a sample's robustness against other classes by computing its distances to the teacher's decision boundaries and use it to construct the soft label for each training sample. After that, the student can be trained via standard KD. We then extend this approach to a more challenging scenario in which even accessing the training data is not feasible. We propose to generate pseudo samples distinguished by the teacher's decision boundaries to the largest extent and construct soft labels for them, which are used as the transfer set. We evaluate our approaches on various benchmark networks and datasets and experiment results demonstrate their effectiveness. Codes are available at: https://github.com/zwang84/zsdb3kd.


title: A comparison principle for parabolic complex Monge-Amp\`ere equations

abstract: In this paper, we study the Cauchy-Dirichlet problem for Parabolic complex Monge-Amp\`ere equations on strongly pseudoconvex domains using the viscosity method. We prove a comparison principle for Parabolic complex Monge-Amp\`ere equations and use it to study the existence and uniqueness of viscosity solution in certain cases where the sets $\{z\in\Omega: f(t, z)=0 \}$ may be pairwise disjoint.


title: High-Throughput Study of Antisolvents on the Stability of Multicomponent Metal Halide Perovskites through Robotics-Based Synthesis and Machine Learning Approaches

abstract: Antisolvent crystallization methods are frequently used to fabricate high-quality perovskite thin films, to produce sizable single crystals, and to synthesize nanoparticles at room temperature. However, a systematic exploration of the effect of specific antisolvents on the intrinsic stability of multicomponent metal halide perovskites has yet to be demonstrated. Here, we develop a high-throughput experimental workflow that incorporates chemical robotic synthesis, automated characterization, and machine learning techniques to explore how the choice of antisolvent affects the intrinsic stability of binary perovskite systems in ambient conditions over time. Different combinations of the endmembers, MAPbI3, MAPbBr3, FAPbI3, FAPbBr3, CsPbI3, and CsPbBr3, are used to synthesize 15 combinatorial libraries, each with 96 unique combinations. In total, roughly 1100 different compositions are synthesized. Each library is fabricated twice using two different antisolvents: toluene and chloroform. Once synthesized, photoluminescence spectroscopy is automatically performed every 5 minutes for approximately 6 hours. Non-negative Matrix Factorization (NMF) is then utilized to map the time- and compositional-dependent optoelectronic properties. Through the utilization of this workflow for each library, we demonstrate that the selection of antisolvent is critical to the stability of metal halide perovskites in ambient conditions. We explore possible dynamical processes, such as halide segregation, responsible for either the stability or eventual degradation as caused by the choice of antisolvent. Overall, this high-throughput study demonstrates the vital role that antisolvents play in the synthesis of high-quality multicomponent metal halide perovskite systems.


title: Robust quantum transport at particle-hole symmetry

abstract: We study quantum transport in disordered systems with particle-hole symmetric Hamiltonians. The particle-hole symmetry is spontaneously broken after averaging with respect to disorder, and the resulting massless mode is treated in a random-phase representation of the invariant measure of the symmetry-group. We compute the resulting fermionic functional integral of the average two-particle Green's function in a perturbation theory around the diffusive limit. The results up to two-loop order show that the corrections vanish, indicating that the diffusive quantum transport is robust. On the other hand, the diffusion coefficient depends strongly on the particle-hole symmetric Hamiltonian we choose to study. This reveals a connection between the underlying microscopic theory and the classical long-scale metallic behaviour of these systems.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.str-el hep-th


title: Measuring Generalization with Optimal Transport

abstract: Understanding the generalization of deep neural networks is one of the most important tasks in deep learning. Although much progress has been made, theoretical error bounds still often behave disparately from empirical observations. In this work, we develop margin-based generalization bounds, where the margins are normalized with optimal transport costs between independent random subsets sampled from the training distribution. In particular, the optimal transport cost can be interpreted as a generalization of variance which captures the structural properties of the learned feature space. Our bounds robustly predict the generalization error, given training data and network parameters, on large scale datasets. Theoretically, we demonstrate that the concentration and separation of features play crucial roles in generalization, supporting empirical results in the literature. The code is available at \url{https://github.com/chingyaoc/kV-Margin}.


title: Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extraction

abstract: Aspect Sentiment Triplet Extraction (ASTE) aims to extract triplets from sentences, where each triplet includes an entity, its associated sentiment, and the opinion span explaining the reason for the sentiment. Most existing research addresses this problem in a multi-stage pipeline manner, which neglects the mutual information between such three elements and has the problem of error propagation. In this paper, we propose a Semantic and Syntactic Enhanced aspect Sentiment triplet Extraction model (S3E2) to fully exploit the syntactic and semantic relationships between the triplet elements and jointly extract them. Specifically, we design a Graph-Sequence duel representation and modeling paradigm for the task of ASTE: we represent the semantic and syntactic relationships between word pairs in a sentence by graph and encode it by Graph Neural Networks (GNNs), as well as modeling the original sentence by LSTM to preserve the sequential information. Under this setting, we further apply a more efficient inference strategy for the extraction of triplets. Extensive evaluations on four benchmark datasets show that S3E2 significantly outperforms existing approaches, which proves our S3E2's superiority and flexibility in an end-to-end fashion.


title: Exploring to establish an appropriate model for image aesthetic assessment via CNN-based RSRL: An empirical study

abstract: To establish an appropriate model for photo aesthetic assessment, in this paper, a D-measure which reflects the disentanglement degree of the final layer FC nodes of CNN is introduced. By combining F-measure with D-measure to obtain a FD measure, an algorithm of determining the optimal model from the multiple photo score prediction models generated by CNN-based repetitively self-revised learning(RSRL) is proposed. Furthermore, the first fixation perspective(FFP) and the assessment interest region(AIR) of the models are defined and calculated. The experimental results show that the FD measure is effective for establishing the appropriate model from the multiple score prediction models with different CNN structures. Moreover, the FD-determined optimal models with the comparatively high FD always have the FFP an AIR which are close to the human's aesthetic perception when enjoying photos.


title: Smooth Implicit Hybrid Upwinding for Compositional Multiphase Flow in Porous Media

abstract: In subsurface multiphase flow simulations, poor nonlinear solver performance is a significant runtime sink. The system of fully implicit mass balance equations is highly nonlinear and often difficult to solve for the nonlinear solver, generally Newton(-Raphson). Strong nonlinearities can cause Newton iterations to converge very slowly. This frequently results in time step cuts, leading to computationally expensive simulations. Much literature has looked into how to improve the nonlinear solver through enhancements or safeguarding updates. In this work, we take a different approach; we aim to improve convergence with a smoother finite volume discretization scheme which is more suitable for the Newton solver. Building on recent work, we propose a novel total velocity hybrid upwinding scheme with weighted average flow mobilities (WA-HU TV) that is unconditionally monotone and extends to compositional multiphase simulations. Analyzing the solution space of a one-cell problem, we demonstrate the improved properties of the scheme and explain how it leverages the advantages of both phase potential upwinding and arithmetic averaging. This results in a flow subproblem that is smooth with respect to changes in the sign of phase fluxes, and is well-behaved when phase velocities are large or when co-current viscous forces dominate. Additionally, we propose a WA-HU scheme with a total mass (WA-HU TM) formulation that includes phase densities in the weighted averaging. The proposed WA-HU TV consistently outperforms existing schemes, yielding benefits from 5\% to over 50\% reduction in nonlinear iterations. The WA-HU TM scheme also shows promising results; in some cases leading to even more efficiency. However, WA-HU TM can occasionally also lead to convergence issues. Overall, based on the current results, we recommend the adoption of the WA-HU TV scheme as it is highly efficient and robust.


title: The Formation and Lifetime of Outflows in a Solar Active Region

abstract: Active regions are thought to be one contributor to the slow solar wind. Upflows in EUV coronal spectral lines are routinely osberved at their boundaries, and provide the most direct way for upflowing material to escape into the heliosphere. The mechanisms that form and drive these upflows, however, remain to be fully characterised. It is unclear how quickly they form, or how long they exist during their lifetimes. They could be initiated low in the atmosphere during magnetic flux emergence, or as a response to processes occuring high in the corona when the active region is fully developed. On 2019, March 31, a simple bipolar active region (AR 12737) emerged and upflows developed on each side. We used observations from Hinode, SDO, IRIS, and Parker Solar Probe (PSP) to investigate the formation and development of the upflows from the eastern side. We used the spectroscopic data to detect the upflow, and then used the imaging data to try to trace its signature back to earlier in the active region emergence phase. We find that the upflow forms quickly, low down in the atmosphere, and that its initiation appears associated with a small field-opening eruption and the onset of a radio noise storm detected by PSP. We also confirmed that the upflows existed for the vast majority of the time the active region was observed. These results suggest that the contribution to the solar wind occurs even when the region is small, and continues for most of its lifetime.


title: A point-plane incidence theorem in matrix rings

abstract: In this paper, we study a point-hyper plane incidence theorem in matrix rings, which generalizes all previous works in literature of this direction.


title: A Communication-Efficient and Privacy-Aware Distributed Algorithm for Sparse PCA

abstract: Sparse principal component analysis (PCA) improves interpretability of the classic PCA by introducing sparsity into the dimension-reduction process. Optimization models for sparse PCA, however, are generally non-convex, non-smooth and more difficult to solve, especially on large-scale datasets requiring distributed computation over a wide network. In this paper, we develop a distributed and centralized algorithm called DSSAL1 for sparse PCA that aims to achieve low communication overheads by adapting a newly proposed subspace-splitting strategy to accelerate convergence. Theoretically, convergence to stationary points is established for DSSAL1. Extensive numerical results show that DSSAL1 requires far fewer rounds of communication than state-of-the-art peer methods. In addition, we make the case that since messages exchanged in DSSAL1 are well-masked, the possibility of private-data leakage in DSSAL1 is much lower than in some other distributed algorithms.


title: Mean Force Based Temperature Accelerated Sliced Sampling: Efficient Reconstruction of High Dimensional Free Energy Landscapes

abstract: Temperature Accelerated Sliced Sampling (TASS) is an efficient method to compute high dimensional free energy landscapes. The original TASS method employs the Weighted Histogram Analysis Method (WHAM) which is an iterative post-processing to reweight and stitch high dimensional probability distributions in sliced windows that are obtained in the presence of restraining biases. The WHAM necessitates that TASS windows lie close to each other for proper overlap of distributions and span the collective variable space of interest. On the other hand, increase in number of TASS windows implies more number of simulations, and thus it affects the efficiency of the method. To overcome this problem, we propose herein a new mean-force (MF) based reweighting scheme called TASS-MF, which enables accurate computation with a fewer number of windows devoid of the WHAM post-processing. Application of the technique is demonstrated for alanine di- and tripeptides in vacuo to compute their two- and four-dimensional free energy landscapes, the latter of which is formidable in conventional umbrella sampling and metadynamics. The landscapes are computed within a kcal/mol accuracy, ensuring a safe usage for broad applications in computational chemistry.


title: Bayesian Time Varying Coefficient Model with Applications to Marketing Mix Modeling

abstract: Both Bayesian and varying coefficient models are very useful tools in practice as they can be used to model parameter heterogeneity in a generalizable way. Motivated by the need of enhancing Marketing Mix Modeling at Uber, we propose a Bayesian Time Varying Coefficient model, equipped with a hierarchical Bayesian structure. This model is different from other time varying coefficient models in the sense that the coefficients are weighted over a set of local latent variables following certain probabilistic distributions. Stochastic Variational Inference is used to approximate the posteriors of latent variables and dynamic coefficients. The proposed model also helps address many challenges faced by traditional MMM approaches. We used simulations as well as real world marketing datasets to demonstrate our model superior performance in terms of both accuracy and interpretability.


title: A Comprehensive Survey and Taxonomy on Single Image Dehazing Based on Deep Learning

abstract: With the development of convolutional neural networks, hundreds of deep learning based dehazing methods have been proposed. In this paper, we provide a comprehensive survey on supervised, semi-supervised, and unsupervised single image dehazing. We first discuss the physical model, datasets, network modules, loss functions, and evaluation metrics that are commonly used. Then, the main contributions of various dehazing algorithms are categorized and summarized. Further, quantitative and qualitative experiments of various baseline methods are carried out. Finally, the unsolved issues and challenges that can inspire the future research are pointed out. A collection of useful dehazing materials is available at \url{https://github.com/Xiaofeng-life/AwesomeDehazing}.


title: Uncertain Process Data with Probabilistic Knowledge: Problem Characterization and Challenges

abstract: Motivated by the abundance of uncertain event data from multiple sources including physical devices and sensors, this paper presents the task of relating a stochastic process observation to a process model that can be rendered from a dataset. In contrast to previous research that suggested to transform a stochastically known event log into a less informative uncertain log with upper and lower bounds on activity frequencies, we consider the challenge of accommodating the probabilistic knowledge into conformance checking techniques. Based on a taxonomy that captures the spectrum of conformance checking cases under stochastic process observations, we present three types of challenging cases. The first includes conformance checking of a stochastically known log with respect to a given process model. The second case extends the first to classify a stochastically known log into one of several process models. The third case extends the two previous ones into settings in which process models are only stochastically known. The suggested problem captures the increasingly growing number of applications in which sensors provide probabilistic process information.


title: Routing optimization on power packet dispatching system based on energy loss minimization

abstract: Power packet dispatching system has been proposed for smart power management in the form of discretized packet. In this paper, we discuss the routing optimization of power packets on the network of power routers. We propose a cost metric for the power packet delivery by circuit analysis of the router network. Using the metric, we formulate the optimization problem as a general shortest path problem from a source node to a load node. The result of numerical simulations shows that the proposed algorithm can allocate distributed power sources to load demands and identify the optimal path for the power delivery.


title: Intrinsic Superconducting Diode Effect

abstract: Stimulated by the recent experiment [F. Ando et al., Nature 584, 373 (2020)], we propose an intrinsic mechanism to cause the superconducting diode effect (SDE). SDE refers to the nonreciprocity of the critical current for the metal-superconductor transition. Among various mechanisms for the critical current, the depairing current is known to be intrinsic to each material and has recently been observed in several superconducting systems. We clarify the temperature scaling of the nonreciprocal depairing current near the critical temperature and point out its significant enhancement at low temperatures. It is also found that the nonreciprocal critical current shows sign reversals upon increasing the magnetic field. These behaviors are understood by the nonreciprocity of the Landau critical momentum and the change in the nature of the helical superconductivity. The intrinsic SDE unveils the rich phase diagram and functionalities of noncentrosymmetric superconductors.


title: Modeling Transverse Space Charge effects in IOTA with pyORBIT

abstract: The role and mitigation of space charge effects are important aspects of the beam physics research to be performed at the Integrable Optics Test Accelerator (IOTA) at Fermilab. The impact of nonlinear integrability (partial and complete) on space charge driven incoherent and coherent resonances will be a new feature of this accelerator and has the potential to influence the design of future low energy proton synchrotrons. In this report we model transverse space charge effects using the PIC code pyORBIT. First we benchmark the single particle tracking results against MADX with checks on symplecticity, tune footprints, and dynamic aperture in a partially integrable lattice realized with a special octupole string insert. Our space charge calculations begin with an examination of the 4D symplecticity. Short term tracking is done first with the initial bare lattice and then with a matching of the rms values with space charge. Next, we explore slow initialization of charge as a technique to establish steady state and reduce emittance growth and beam loss following injection into a mismatched lattice. We establish values of space charge simulation parameters so as to ensure numerical convergence. Finally, we compare the simulated space charge induced tune shifts and footprints against theory.


title: Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

abstract: Secure aggregation is a critical component in federated learning (FL), which enables the server to learn the aggregate model of the users without observing their local models. Conventionally, secure aggregation algorithms focus only on ensuring the privacy of individual users in a single training round. We contend that such designs can lead to significant privacy leakages over multiple training rounds, due to partial user selection/participation at each round of FL. In fact, we show that the conventional random user selection strategies in FL lead to leaking users' individual models within number of rounds that is linear in the number of users. To address this challenge, we introduce a secure aggregation framework, Multi-RoundSecAgg, with multi-round privacy guarantees. In particular, we introduce a new metric to quantify the privacy guarantees of FL over multiple training rounds, and develop a structured user selection strategy that guarantees the long-term privacy of each user (over any number of training rounds). Our framework also carefully accounts for the fairness and the average number of participating users at each round. Our experiments on MNIST and CIFAR-10 datasets in the IID and the non-IID settings demonstrate the performance improvement over the baselines, both in terms of privacy protection and test accuracy.


title: Improved Method for Dealing with Discontinuities in Power System Transient Simulation Based on Frequency Response Optimized Integrators Considering Second Order Derivative

abstract: Potential disagreement in the result induced by discontinuities is revealed in this paper between a novel power system transient simulation scheme using numerical integrators considering second order derivative and conventional ones using numerical integrators considering first order derivative. The disagreement is due to the formula of the different numerical integrators. An improved method for dealing with discontinuities in the novel transient simulation scheme is proposed to resolve the disagreement. The effectiveness of the improved method is demonstrated and verified via numerical case studies. Although the disagreement is studied on and the improved method is proposed for a particular transient simulation scheme, similar conclusions also apply to other ones using numerical integrators considering high order derivative.


title: Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation

abstract: In this paper, we propose Contextual Guided Segmentation (CGS) framework for video instance segmentation in three passes. In the first pass, i.e., preview segmentation, we propose Instance Re-Identification Flow to estimate main properties of each instance (i.e., human/non-human, rigid/deformable, known/unknown category) by propagating its preview mask to other frames. In the second pass, i.e., contextual segmentation, we introduce multiple contextual segmentation schemes. For human instance, we develop skeleton-guided segmentation in a frame along with object flow to correct and refine the result across frames. For non-human instance, if the instance has a wide variation in appearance and belongs to known categories (which can be inferred from the initial mask), we adopt instance segmentation. If the non-human instance is nearly rigid, we train FCNs on synthesized images from the first frame of a video sequence. In the final pass, i.e., guided segmentation, we develop a novel fined-grained segmentation method on non-rectangular regions of interest (ROIs). The natural-shaped ROI is generated by applying guided attention from the neighbor frames of the current one to reduce the ambiguity in the segmentation of different overlapping instances. Forward mask propagation is followed by backward mask propagation to further restore missing instance fragments due to re-appeared instances, fast motion, occlusion, or heavy deformation. Finally, instances in each frame are merged based on their depth values, together with human and non-human object interaction and rare instance priority. Experiments conducted on the DAVIS Test-Challenge dataset demonstrate the effectiveness of our proposed framework. We achieved the 3rd consistently in the DAVIS Challenges 2017-2019 with 75.4%, 72.4%, and 78.4% in terms of global score, region similarity, and contour accuracy, respectively.


title: SelfDoc: Self-Supervised Document Representation Learning

abstract: We propose SelfDoc, a task-agnostic pre-training framework for document image understanding. Because documents are multimodal and are intended for sequential reading, our framework exploits the positional, textual, and visual information of every semantically meaningful component in a document, and it models the contextualization between each block of content. Unlike existing document pre-training models, our model is coarse-grained instead of treating individual words as input, therefore avoiding an overly fine-grained with excessive contextualization. Beyond that, we introduce cross-modal learning in the model pre-training phase to fully leverage multimodal information from unlabeled documents. For downstream usage, we propose a novel modality-adaptive attention mechanism for multimodal feature fusion by adaptively emphasizing language and vision signals. Our framework benefits from self-supervised pre-training on documents without requiring annotations by a feature masking training strategy. It achieves superior performance on multiple downstream tasks with significantly fewer document images used in the pre-training stage compared to previous works.


title: Voltage-control of damping constant in magnetic-insulator/topological-insulator bilayers

abstract: The magnetic damping constant is a critical parameter for magnetization dynamics and the efficiency of memory devices and magnon transport. Therefore, its manipulation by electric fields is crucial in spintronics. Here, we theoretically demonstrate the voltage-control of magnetic damping in ferro- and ferrimagnetic-insulator (FI)/topological-insulator (TI) bilayers. Assuming a capacitor-like setup, we formulate an effective dissipation torque induced by spin-charge pumping at the FI/TI interface as a function of an applied voltage. By using realistic material parameters, we find that the effective damping for a FI with 10nm thickness can be tuned by one order of magnitude under the voltage with 0.25V. Also, we provide perspectives on the voltage-induced modulation of the magnon spin transport on proximity-coupled FIs.


title: The role of crosslinking density in surface stress and surface energy of soft solids

abstract: Surface stress and surface energy are two fundamental parameters that determine the surface properties of any materials. While it is commonly believed that the surface stress and surface energy of liquids are identical, the relationship between the two parameters in soft polymeric gels remains debatable. In this work, we measured the surface stress and surface energy of soft silicone gels with varying weight ratios of crosslinkers in soft wetting experiments. Above a critical density, $k_0$, the surface stress was found to increase significantly with crosslinking density while the surface energy remained unchanged. In this regime, we can estimate a non-zero surface elastic modulus that also increases with the ratio of crosslinkers. By comparing the surface mechanics of the soft gels with their bulk rheology, the surface properties near the critical density $k_0$ were found to be closely related to the underlying percolation transition of the polymer networks.


title: Joint Learning of Multiple Differential Networks with fMRI data for Brain Connectivity Alteration Detection

abstract: In this study we focus on the problem of joint learning of multiple differential networks with function Magnetic Resonance Imaging (fMRI) data sets from multiple research centers. As the research centers may use different scanners and imaging parameters, joint learning of differential networks with fMRI data from different centers may reflect the underlying mechanism of neurological diseases from different perspectives while capturing the common structures. We transform the task as a penalized logistic regression problem, and exploit sparse group Minimax Concave Penalty (gMCP) to induce common structures among multiple differential networks and the sparse structures of each differential network. To further enhance the empirical performance, we develop an ensemble-learning procedure. We conduct thorough simulation study to assess the finite-sample performance of the proposed method and compare with state-of-the-art alternatives. We apply the proposed method to analyze fMRI datasets related with Attention Deficit Hyperactivity Disorder from various research centers. The identified common hub nodes and differential interaction patterns coincides with the existing experimental studies.


title: Singmaster's conjecture in the interior of Pascal's triangle

abstract: Singmaster's conjecture asserts that every natural number greater than one occurs at most a bounded number of times in Pascal's triangle; that is, for any natural number $t \geq 2$, the number of solutions to the equation $\binom{n}{m} = t$ for natural numbers $1 \leq m < n$ is bounded. In this paper we establish this result in the interior region $\exp(\log^{2/3+\varepsilon} n) \leq m \leq n-\exp(\log^{2/3 + \varepsilon} n)$ for any fixed $\varepsilon > 0$. Indeed, when $t$ is sufficiently large depending on $\varepsilon$, we show that there are at most four solutions (or at most two in either half of Pascal's triangle) in this region. We also establish analogous results for the equation $(n)_m = t$, where $(n)_m := n(n-1)\ldots(n-m+1)$ denotes the falling factorial.


title: Wide-Baseline Relative Camera Pose Estimation with Directional Learning

abstract: Modern deep learning techniques that regress the relative camera pose between two images have difficulty dealing with challenging scenarios, such as large camera motions resulting in occlusions and significant changes in perspective that leave little overlap between images. These models continue to struggle even with the benefit of large supervised training datasets. To address the limitations of these models, we take inspiration from techniques that show regressing keypoint locations in 2D and 3D can be improved by estimating a discrete distribution over keypoint locations. Analogously, in this paper we explore improving camera pose regression by instead predicting a discrete distribution over camera poses. To realize this idea, we introduce DirectionNet, which estimates discrete distributions over the 5D relative pose space using a novel parameterization to make the estimation problem tractable. Specifically, DirectionNet factorizes relative camera pose, specified by a 3D rotation and a translation direction, into a set of 3D direction vectors. Since 3D directions can be identified with points on the sphere, DirectionNet estimates discrete distributions on the sphere as its output. We evaluate our model on challenging synthetic and real pose estimation datasets constructed from Matterport3D and InteriorNet. Promising results show a near 50% reduction in error over direct regression methods.


title: Summary Grounded Conversation Generation

abstract: Many conversation datasets have been constructed in the recent years using crowdsourcing. However, the data collection process can be time consuming and presents many challenges to ensure data quality. Since language generation has improved immensely in recent years with the advancement of pre-trained language models, we investigate how such models can be utilized to generate entire conversations, given only a summary of a conversation as the input. We explore three approaches to generate summary grounded conversations, and evaluate the generated conversations using automatic measures and human judgements. We also show that the accuracy of conversation summarization can be improved by augmenting a conversation summarization dataset with generated conversations.


title: On the Hausdorff dimension of Furstenberg sets and orthogonal projections in the plane

abstract: Let $0 \leq s \leq 1$ and $0 \leq t \leq 2$. An $(s,t)$-Furstenberg set is a set $K \subset \mathbb{R}^{2}$ with the following property: there exists a line set $\mathcal{L}$ of Hausdorff dimension $\dim_{\mathrm{H}} \mathcal{L} \geq t$ such that $\dim_{\mathrm{H}} (K \cap \ell) \geq s$ for all $\ell \in \mathcal{L}$. We prove that for $s\in (0,1)$, and $t \in (s,2]$, the Hausdorff dimension of $(s,t)$-Furstenberg sets in $\mathbb{R}^{2}$ is no smaller than $2s + \epsilon$, where $\epsilon > 0$ depends only on $s$ and $t$. For $s>1/2$ and $t = 1$, this is an $\epsilon$-improvement over a result of Wolff from 1999. The same method also yields an $\epsilon$-improvement to Kaufman's projection theorem from 1968. We show that if $s \in (0,1)$, $t \in (s,2]$ and $K \subset \mathbb{R}^{2}$ is an analytic set with $\dim_{\mathrm{H}} K = t$, then $$\dim_{\mathrm{H}} \{e \in S^{1} : \dim_{\mathrm{H}} \pi_{e}(K) \leq s\} \leq s - \epsilon,$$ where $\epsilon > 0$ only depends on $s$ and $t$. Here $\pi_{e}$ is the orthogonal projection to $\mathrm{span}(e)$.


title: Anisotropic interpolation error estimates using a new geometric parameter

abstract: We present precise anisotropic interpolation error estimates for smooth functions using a new geometric parameter and derive inverse inequalities on anisotropic meshes. In our theory, the interpolation error is bounded in terms of the diameter of a simplex and the geometric parameter. Imposing additional assumptions makes it possible to obtain anisotropic error estimates. This paper also includes corrections to an error in Theorem 2 of our previous paper, "General theory of interpolation error estimates on anisotropic meshes" (Japan Journal of Industrial and Applied Mathematics, 38 (2021) 163-191).


title: Instrument Space Selection for Kernel Maximum Moment Restriction

abstract: Kernel maximum moment restriction (KMMR) recently emerges as a popular framework for instrumental variable (IV) based conditional moment restriction (CMR) models with important applications in conditional moment (CM) testing and parameter estimation for IV regression and proximal causal learning. The effectiveness of this framework, however, depends critically on the choice of a reproducing kernel Hilbert space (RKHS) chosen as a space of instruments. In this work, we presents a systematic way to select the instrument space for parameter estimation based on a principle of the least identifiable instrument space (LIIS) that identifies model parameters with the least space complexity. Our selection criterion combines two distinct objectives to determine such an optimal space: (i) a test criterion to check identifiability; (ii) an information criterion based on the effective dimension of RKHSs as a complexity measure. We analyze the consistency of our method in determining the LIIS, and demonstrate its effectiveness for parameter estimation via simulations.


title: Glitch analysis and braking index determination of the unique source PSR J0537-6910

abstract: PSR J0537$-$6910 is the most active glitching pulsar with a glitch rate $\sim0.3$ yr $^{-1}$. We have reanalysed 45 glitches of PSR J0537$-$6910 published in the literature and have done post-glitch timing fits within the vortex creep model. Moment of inertia fractions of the superfluid regions participating in glitches are obtained for each event and the model predictions for the inter-glitch time are confronted with the observed time-scales. Similarities and differences with the glitching behaviours of the well studied Crab and Vela pulsars are highlighted. From superfluid recoupling time-scales we estimate an inner crust temperature of $T=0.9\times10^{8}$ K for PSR J0537$-$6910. It is found that PSR J0537$-$6910 glitches leave behind persistent shifts similar to those observed from the Crab pulsar. These persistent shifts are responsible for the long term increase of the spin-down rate of PSR J0537$-$6910 and the apparent negative trend in its braking. Glitch magnitudes and persistent shifts of PSR J0537$-$6910 are consistent with the scenario that this is a young pulsar in the process of developing new vortex traps. We determine a braking index $n=2.7(4)$ after glitch induced contributions to the rotational evolution have been removed.


title: Fermionic Construction in the Supersymmetric Coset Model

abstract: It is known previously that the operator product expansion (OPE) between the first ${\cal N}=3 $ multiplet and itself contains the second ${\cal N}=3$ multiplet in the supersymmetric coset model. In this paper, by using their realizations in terms of various fermions, we compute the four kinds of OPEs between the first and the second ${\cal N}=3$ multiplets for fixed $N$ and $M$ where the group of the coset contains $SU(N+M)$. By supersymmetrizing the above OPEs in ${\cal N}=3$ superspace and using the various Jacobi identities between the currents, we determine the ${\cal N}=3$ supersymmetric OPE between the first and the second ${\cal N}=3$ multiplets completely. The right hand side of this OPE contains the various ${\cal N}=3$ multiplets: the $SO(3)$ singlet ${\cal N}=3$ multiplets of superspin-$\frac{3}{2},2,3,4$ and the $SO(3)$ triplet ${\cal N}=3$ multiplets of superspin-$\frac{5}{2},3,\frac{7}{2}$. The ${\cal N}=2$ superspace description and the decoupling of the spin-$\frac{1}{2}$ current of the ${\cal N}=3$ superconformal algebra are also described.


title: Energy Aligning for Biased Models

abstract: Training on class-imbalanced data usually results in biased models that tend to predict samples into the majority classes, which is a common and notorious problem. From the perspective of energy-based model, we demonstrate that the free energies of categories are aligned with the label distribution theoretically, thus the energies of different classes are expected to be close to each other when aiming for ``balanced'' performance. However, we discover a severe energy-bias phenomenon in the models trained on class-imbalanced dataset. To eliminate the bias, we propose a simple and effective method named Energy Aligning by merely adding the calculated shift scalars onto the output logits during inference, which does not require to (i) modify the network architectures, (ii) intervene the standard learning paradigm, (iii) perform two-stage training. The proposed algorithm is evaluated on two class imbalance-related tasks under various settings: class incremental learning and long-tailed recognition. Experimental results show that energy aligning can effectively alleviate class imbalance issue and outperform state-of-the-art methods on several benchmarks.


title: Statistical Inference for High-Dimensional Linear Regression with Blockwise Missing Data

abstract: Blockwise missing data occurs frequently when we integrate multisource or multimodality data where different sources or modalities contain complementary information. In this paper, we consider a high-dimensional linear regression model with blockwise missing covariates and a partially observed response variable. Under this framework, we propose a computationally efficient estimator for the regression coefficient vector based on carefully constructed unbiased estimating equations and a blockwise imputation procedure, and obtain its rate of convergence. Furthermore, building upon an innovative projected estimating equation technique that intrinsically achieves bias-correction of the initial estimator, we propose a nearly unbiased estimator for each individual regression coefficient, which is asymptotically normally distributed under mild conditions. Based on these debiased estimators, asymptotically valid confidence intervals and statistical tests about each regression coefficient are constructed. Numerical studies and application analysis of the Alzheimer's Disease Neuroimaging Initiative data show that the proposed method performs better and benefits more from unsupervised samples than existing methods.


title: A Joint Model for Dropped Pronoun Recovery and Conversational Discourse Parsing in Chinese Conversational Speech

abstract: In this paper, we present a neural model for joint dropped pronoun recovery (DPR) and conversational discourse parsing (CDP) in Chinese conversational speech. We show that DPR and CDP are closely related, and a joint model benefits both tasks. We refer to our model as DiscProReco, and it first encodes the tokens in each utterance in a conversation with a directed Graph Convolutional Network (GCN). The token states for an utterance are then aggregated to produce a single state for each utterance. The utterance states are then fed into a biaffine classifier to construct a conversational discourse graph. A second (multi-relational) GCN is then applied to the utterance states to produce a discourse relation-augmented representation for the utterances, which are then fused together with token states in each utterance as input to a dropped pronoun recovery layer. The joint model is trained and evaluated on a new Structure Parsing-enhanced Dropped Pronoun Recovery (SPDPR) dataset that we annotated with both two types of information. Experimental results on the SPDPR dataset and other benchmarks show that DiscProReco significantly outperforms the state-of-the-art baselines of both tasks.