title: Using BERT Encoding to Tackle the Mad-lib Attack in SMS Spam Detection

abstract: One of the stratagems used to deceive spam filters is to substitute vocables with synonyms or similar words that turn the message unrecognisable by the detection algorithms. In this paper we investigate whether the recent development of language models sensitive to the semantics and context of words, such as Google's BERT, may be useful to overcome this adversarial attack (called "Mad-lib" as per the word substitution game). Using a dataset of 5572 SMS spam messages, we first established a baseline of detection performance using widely known document representation models (BoW and TFIDF) and the novel BERT model, coupled with a variety of classification algorithms (Decision Tree, kNN, SVM, Logistic Regression, Naive Bayes, Multilayer Perceptron). Then, we built a thesaurus of the vocabulary contained in these messages, and set up a Mad-lib attack experiment in which we modified each message of a held out subset of data (not used in the baseline experiment) with different rates of substitution of original words with synonyms from the thesaurus. Lastly, we evaluated the detection performance of the three representation models (BoW, TFIDF and BERT) coupled with the best classifier from the baseline experiment (SVM). We found that the classic models achieved a 94% Balanced Accuracy (BA) in the original dataset, whereas the BERT model obtained 96%. On the other hand, the Mad-lib attack experiment showed that BERT encodings manage to maintain a similar BA performance of 96% with an average substitution rate of 1.82 words per message, and 95% with 3.34 words substituted per message. In contrast, the BA performance of the BoW and TFIDF encoders dropped to chance. These results hint at the potential advantage of BERT models to combat these type of ingenious attacks, offsetting to some extent for the inappropriate use of semantic relationships in language.


title: Semantically-Aware Strategies for Stereo-Visual Robotic Obstacle Avoidance

abstract: Mobile robots in unstructured, mapless environments must rely on an obstacle avoidance module to navigate safely. The standard avoidance techniques estimate the locations of obstacles with respect to the robot but are unaware of the obstacles' identities. Consequently, the robot cannot take advantage of semantic information about obstacles when making decisions about how to navigate. We propose an obstacle avoidance module that combines visual instance segmentation with a depth map to classify and localize objects in the scene. The system avoids obstacles differentially, based on the identity of the objects: for example, the system is more cautious in response to unpredictable objects such as humans. The system can also navigate closer to harmless obstacles and ignore obstacles that pose no collision danger, enabling it to navigate more efficiently. We validate our approach in two simulated environments: one terrestrial and one underwater. Results indicate that our approach is feasible and can enable more efficient navigation strategies.


title: Mining Idioms in the Wild

abstract: Existing code repositories contain numerous instances of code patterns that are idiomatic ways of accomplishing a particular programming task. Sometimes, the programming language in use supports specific operators or APIs that can express the same idiomatic imperative code much more succinctly. However, those code patterns linger in repositories because the developers may be unaware of the new APIs or have not gotten around to them. Detection of idiomatic code can also point to the need for new APIs. We share our experiences in mine idiomatic patterns from the Hack repo at Facebook. We found that existing techniques either cannot identify meaningful patterns from syntax trees or require test-suite-based dynamic analysis to incorporate semantic properties to mine useful patterns. The key insight of the approach proposed in this paper -- \emph{Jezero} -- is that semantic idioms from a large codebase can be learned from \emph{canonicalized} dataflow trees. We propose a scalable, lightweight static analysis-based approach to construct such a tree that is well suited to mine semantic idioms using nonparametric Bayesian methods. Our experiments with Jezero on Hack code shows a clear advantage of adding canonicalized dataflow information to ASTs: \emph{Jezero} was significantly more effective than a baseline that did not have the dataflow augmentation in being able to effectively find refactoring opportunities from unannotated legacy code.


title: Evidence from on-site atom number fluctuations for a quantum Berezinskii-Kosterlitz-Thouless transition in the one-dimensional Bose-Hubbard model

abstract: We study the one-dimensional Bose-Hubbard model describing the superfluid-Mott insulator quantum phase transition of cold atoms in optical lattices. We show that derivatives of the variance of the on-site atom number occupation, computed with respect to the parameter driving the transition, have extrema that are located off the critical point even in the thermodynamic limit. We discuss whether such extrema provide solid evidence of the quantum Berezinskii-Kosterlitz-Thouless transition taking place in this system. The calculations are done for systems with the mean number of atoms per lattice site equal to either one or two. They also characterize the nearest-neighbor correlation function, which is typically discussed in the context of time-of-flight images of cold atoms.


title: Success of digital adiabatic simulation with large Trotter step

abstract: The simulation of adiabatic evolution has deep connections with Adiabatic Quantum Computation, the Quantum Approximate Optimization Algorithm and adiabatic state preparation. Here we address the error analysis problem in quantum simulation of adiabatic process using Trotter formulas. We show that with additional conditions, the circuit depth can be linear in simulation time $T$. The improvement comes from the observation that the fidelity error here can't be estimated by the norm distance between evolution operators. This phenomenon is termed as the robustness of discretization in digital adiabatic simulation. It can be explained in three steps, from analytical and numerical evidence: (1). The fidelity error should be estimated by applying adiabatic theorem on the effective Hamiltonian instead. (2). Because of the specialty of Riemann-Lebesgue lemma, most adiabatic process is naturally robust against discretization. (3). As the Trotter step gets larger, the spectral gap of effective Hamiltonian tends to close, which results in the failure of digital adiabatic simulation.


title: Shortest-Path Constrained Reinforcement Learning for Sparse Reward Tasks

abstract: We propose the k-Shortest-Path (k-SP) constraint: a novel constraint on the agent's trajectory that improves the sample efficiency in sparse-reward MDPs. We show that any optimal policy necessarily satisfies the k-SP constraint. Notably, the k-SP constraint prevents the policy from exploring state-action pairs along the non-k-SP trajectories (e.g., going back and forth). However, in practice, excluding state-action pairs may hinder the convergence of RL algorithms. To overcome this, we propose a novel cost function that penalizes the policy violating SP constraint, instead of completely excluding it. Our numerical experiment in a tabular RL setting demonstrates that the SP constraint can significantly reduce the trajectory space of policy. As a result, our constraint enables more sample efficient learning by suppressing redundant exploration and exploitation. Our experiments on MiniGrid, DeepMind Lab, Atari, and Fetch show that the proposed method significantly improves proximal policy optimization (PPO) and outperforms existing novelty-seeking exploration methods including count-based exploration even in continuous control tasks, indicating that it improves the sample efficiency by preventing the agent from taking redundant actions.


title: A Theoretical Framework for Learning from Quantum Data

abstract: Over decades traditional information theory of source and channel coding advances toward learning and effective extraction of information from data. We propose to go one step further and offer a theoretical foundation for learning classical patterns from quantum data. However, there are several roadblocks to lay the groundwork for such a generalization. First, classical data must be replaced by a density operator over a Hilbert space. Hence, deviated from problems such as state tomography, our samples are i.i.d density operators. The second challenge is even more profound since we must realize that our only interaction with a quantum state is through a measurement which -- due to no-cloning quantum postulate -- loses information after measuring it. With this in mind, we present a quantum counterpart of the well-known PAC framework. Based on that, we propose a quantum analogous of the ERM algorithm for learning measurement hypothesis classes. Then, we establish upper bounds on the quantum sample complexity quantum concept classes.


title: Watching Single Unmodified Enzymes at Work

abstract: Many proteins undergo conformational changes during their activity. A full understanding of the function of these proteins can only be obtained if different conformations and transitions between them can be monitored in aqueous solution, with adequate temporal resolution and, ideally, on a single-molecule level. Interrogating conformational dynamics of single proteins remains, however, exquisitely challenging and typically requires site-directed chemical modification combined with rigorous minimization of possible artifacts. These obstacles limit the number of single-protein investigations. The work presented here introduces an approach that traps single unmodified proteins from solution in a plasmonic hotspot and makes it possible to assign changes in refractive index to changes in protein conformation while monitoring these changes for minutes to hours with a temporal resolution at least as fast as 40 microseconds. The resulting single molecule data reveals that adenylate kinase employs a hidden enzymatic sub-cycle during catalysis, that citrate synthase populates a previously unknown intermediate conformation, which is more important for its enzymatic activity than its well-known open conformation, that hemoglobin transitions in several steps from its deoxygenated and rigid T state to its oxygenated and flexible R state, and that apo-calmodulin thermally unfolds and refolds in steps that correspond to conformational changes of individual protein domains.


title: Bidiagonal Triads and the Tetrahedron Algebra

abstract: We introduce a linear algebraic object called a bidiagonal triad. A bidiagonal triad is a modification of the previously studied and similarly defined concept of bidiagonal triple. A bidiagonal triad and a bidiagonal triple both consist of three diagonalizable linear transformations on a finite-dimensional vector space, each of which acts in a bidiagonal fashion on the eigenspaces of the other two. A triad differs from a triple in the way these bidiagonal actions are defined. We modify a number of theorems about bidiagonal triples to the case of bidiagonal triads. We also describe the close relationship between bidiagonal triads and the representation theory of the tetrahedron Lie algebra.


title: The Foes of Neural Network's Data Efficiency Among Unnecessary Input Dimensions

abstract: Datasets often contain input dimensions that are unnecessary to predict the output label, e.g. background in object recognition, which lead to more trainable parameters. Deep Neural Networks (DNNs) are robust to increasing the number of parameters in the hidden layers, but it is unclear whether this holds true for the input layer. In this letter, we investigate the impact of unnecessary input dimensions on a central issue of DNNs: their data efficiency, ie. the amount of examples needed to achieve certain generalization performance. Our results show that unnecessary input dimensions that are task-unrelated substantially degrade data efficiency. This highlights the need for mechanisms that remove {task-unrelated} dimensions to enable data efficiency gains.


title: Tuning the Optical Properties of an MoSe$_2$ Monolayer Using Nanoscale Plasmonic Antennas

abstract: Nanoplasmonic systems combined with optically-active two-dimensional materials provide intriguing opportunities to explore and control light-matter interactions at extreme sub-wavelength lengthscales approaching the exciton Bohr radius. Here, we present room- and cryogenic-temperature investigations of light-matter interactions between an MoSe$_2$ monolayer and individual lithographically defined gold dipole nanoantennas having sub-10 nm feed gaps. By progressively tuning the nanoantenna size, their dipolar resonance is tuned relative to the A-exciton transition in a proximal MoSe$_2$ monolayer achieving a total tuning of $\sim 130\;\mathrm{meV}$. Differential reflectance measurements performed on $> 100$ structures reveal an apparent avoided crossing between exciton and dipolar mode and an exciton-plasmon coupling constant of $g= 55\;\mathrm{meV}$, representing $g/(\hbar\omega_X)\geq3\%$ of the transition energy. This places our hybrid system in the intermediate-coupling regime where spectra exhibit a characteristic Fano-like shape, indicative of the interplay between pronounced light-matter coupling and significant damping. We also demonstrate active control of the optical response by varying the polarization of the excitation light to programmably suppress coupling to the dipole mode. We further study the emerging optical signatures of the monolayer localized at dipole nanoantennas at $10\;\mathrm{K}$. Our findings represent a key step towards realizing non-linear photonic devices based on 2D materials with potential for low-energy and ultrafast performance.


title: Upper bounds on device-independent quantum key distribution rates in static and dynamic scenarios

abstract: In this work, we develop upper bounds for key rates for device-independent quantum key distribution (DI-QKD) protocols and devices. We study the reduced cc-squashed entanglement and show that it is a convex functional. As a result, we show that the convex hull of the currently known bounds is a tighter upper bound on the device-independent key rates of standard CHSH-based protocol. We further provide tighter bounds for DI-QKD key rates achievable by any protocol applied to the CHSH-based device. This bound is based on reduced relative entropy of entanglement optimized over decompositions into local and non-local parts. In the dynamical scenario of quantum channels, we obtain upper bounds for device-independent private capacity for the CHSH based protocols. We show that the device-independent private capacity for the CHSH based protocols on depolarizing and erasure channels is limited by the secret key capacity of dephasing channels.


title: The Impact of Stellar Clustering on the Observed Multiplicity of Super-Earth systems: Outside-in Cascade of Orbital Misalignments Initiated by Stellar Flybys

abstract: A recent study suggests that the observed multiplicity of super-Earth (SE) systems is correlated with stellar overdensities: field stars in high phase-space density environments have an excess of single-planet systems compared to stars in low density fields. This correlation is puzzling as stellar clustering is expected to influence mostly the outer part of planetary systems. Here we examine the possibility that stellar flybys indirectly excite the mutual inclinations of initially coplanar SEs, breaking their co-transiting geometry. We propose that flybys excite the inclinations of exterior substellar companions, which then propagate the perturbation to the inner SEs. Using analytical calculations of the secular coupling between SEs and companions, together with numerical simulations of stellar encounters, we estimate the expected number of "effective" flybys per planetary system that lead to the destruction of the SE co-transiting geometry. Our analytical results can be rescaled easily for various SE and companion properties (masses and semi-major axes) and stellar cluster parameters (density, velocity dispersion and lifetime). We show that for a given SE system, there exists an optimal companion architecture that leads to the maximum number of effective flybys; this results from the trade-off between the flyby cross section and the companion's impact on the inner system. Subject to uncertainties in the cluster parameters, we conclude that this mechanism is inefficient if the SE system has a single exterior companion, but may play an important role in "SE + two companions" systems that were born in dense stellar clusters. Whether this effect causes the observed correlation between planet multiplicity and stellar overdensities remains to be confirmed.


title: Monotonicity and Noise-Tolerance in Case-Based Reasoning with Abstract Argumentation (with Appendix)

abstract: Recently, abstract argumentation-based models of case-based reasoning ($AA{\text -} CBR$ in short) have been proposed, originally inspired by the legal domain, but also applicable as classifiers in different scenarios. However, the formal properties of $AA{\text -} CBR$ as a reasoning system remain largely unexplored. In this paper, we focus on analysing the non-monotonicity properties of a regular version of $AA{\text -} CBR$ (that we call $AA{\text -} CBR_{\succeq}$). Specifically, we prove that $AA{\text -} CBR_{\succeq}$ is not cautiously monotonic, a property frequently considered desirable in the literature. We then define a variation of $AA{\text -} CBR_{\succeq}$ which is cautiously monotonic. Further, we prove that such variation is equivalent to using $AA{\text -} CBR_{\succeq}$ with a restricted casebase consisting of all "surprising" and "sufficient" cases in the original casebase. As a by-product, we prove that this variation of $AA{\text -} CBR_{\succeq}$ is cumulative, rationally monotonic, and empowers a principled treatment of noise in "incoherent" casebases. Finally, we illustrate $AA{\text -} CBR$ and cautious monotonicity questions on a case study on the U.S. Trade Secrets domain, a legal casebase.


title: Generalized multifractality at spin quantum Hall transition

abstract: Generalized multifractality characterizes scaling of eigenstate observables at Anderson-localization critical points. We explore generalized multifractality in 2D systems, with the main focus on the spin quantum Hall (SQH) transition in superconductors of symmetry class C. Relations and differences with the conventional integer quantum Hall (IQH) transition are also studied. Using the field-theoretical formalism of non-linear sigma-model, we derive the pure-scaling operators representing generalizing multifractality and then "translate" them to the language of eigenstate observables. Performing numerical simulations on network models for SQH and IQH transitions, we confirm the analytical predictions for scaling observables and determine the corresponding exponents. Remarkably, the generalized-multifractality exponents at the SQH critical point strongly violate the generalized parabolicity of the spectrum, which implies violation of the local conformal invariance at this critical point.


title: The Master and Parasite Attack

abstract: We explore a new type of malicious script attacks: the persistent parasite attack. Persistent parasites are stealthy scripts, which persist for a long time in the browser's cache. We show to infect the caches of victims with parasite scripts via TCP injection. Once the cache is infected, we implement methodologies for propagation of the parasites to other popular domains on the victim client as well as to other caches on the network. We show how to design the parasites so that they stay long time in the victim's cache not restricted to the duration of the user's visit to the web site. We develop covert channels for communication between the attacker and the parasites, which allows the attacker to control which scripts are executed and when, and to exfiltrate private information to the attacker, such as cookies and passwords. We then demonstrate how to leverage the parasites to perform sophisticated attacks, and evaluate the attacks against a range of applications and security mechanisms on popular browsers. Finally we provide recommendations for countermeasures.


title: Multi-Step Critiquing User Interface for Recommender Systems

abstract: Recommendations with personalized explanations have been shown to increase user trust and perceived quality and help users make better decisions. Moreover, such explanations allow users to provide feedback by critiquing them. Several algorithms for recommender systems with multi-step critiquing have therefore been developed. However, providing a user-friendly interface based on personalized explanations and critiquing has not been addressed in the last decade. In this paper, we introduce four different web interfaces (available under https://lia.epfl.ch/critiquing/) helping users making decisions and finding their ideal item. We have chosen the hotel recommendation domain as a use case even though our approach is trivially adaptable for other domains. Moreover, our system is model-agnostic (for both recommender systems and critiquing models) allowing a great flexibility and further extensions. Our interfaces are above all a useful tool to help research in recommendation with critiquing. They allow to test such systems on a real use case and also to highlight some limitations of these approaches to find solutions to overcome them.


title: A Universal Cloud Composition on the Nightsides of Hot Jupiters

abstract: The day and nightside temperatures of hot Jupiters are diagnostic of heat transport processes in their atmospheres. Recent observations have shown that the nightsides of hot Jupiters are a nearly constant 1100 K for a wide range of equilibrium temperatures (T$_{eq}$), lower than those predicted by 3D global circulation models. Here we investigate the impact of nightside clouds on the observed nightside temperatures of hot Jupiters using an aerosol microphysics model. We find that silicates dominate the cloud composition, forming an optically thick cloud deck on the nightsides of all hot Jupiters with T$_{eq}$ $\leq$ 2100 K. The observed nightside temperature is thus controlled by the optical depth profile of the silicate cloud with respect to the temperature-pressure profile. As nightside temperatures increase with T$_{eq}$, the silicate cloud is pushed upwards, forcing observations to probe cooler altitudes. The cloud vertical extent remains fairly constant due to competing impacts of increasing vertical mixing strength with T$_{eq}$ and higher rates of sedimentation at higher altitudes. These effects, combined with the intrinsically subtle increase of the nightside temperature with T$_{eq}$ due to decreasing radiative timescale at higher instellation levels lead to low, constant nightside photospheric temperatures consistent with observations. Our results suggest a drastic reduction in the day-night temperature contrast when nightside clouds dissipate, with the nightside emission spectra transitioning from featureless to feature-rich. We also predict that cloud absorption features in the nightside emission spectra of hot Jupiters should reach $\geq$100 ppm, potentially observable with the James Webb Space Telescope.


title: Epidemic models in measure spaces: persistence, concentration and oscillations

abstract: We investigate the long-time dynamics of a SIR epidemic model in the case of a population of pathogens infecting a homogeneous host population. The pathogen population is structured by a genotypic variable. When the initial mass of the maximal fitness set is positive, we give a precise description of the convergence of the orbit, including a formula for the asymptotic distribution. When this initial mass is zero, we show the persistence of the population of infected and the concentration of the population of pathogens on the set of genotypic traits that maximize the fitness. We also investigate precisely the case of a finite number of regular global maxima and show that the initial distribution may have an influence on the support of the eventual distribution. In particular, the natural process of competition is not always selecting a unique species, but several species may coexist as long as they maximize the fitness function. In some configurations, species that maximize the fitness may still get extinct depending on the shape of the initial distribution and some other parameter of the model, and we provide a way to characterize when this unexpected extinction happens. Finally, we provide an example of a pathological situation in which the distribution never reaches a stationary distribution but oscillates forever around the set of fitness maxima.


title: FLAT: An Optimized Dataflow for Mitigating Attention Bottlenecks

abstract: Attention mechanisms, primarily designed to capture pairwise correlations between words, have become the backbone of machine learning, expanding beyond natural language processing into other domains. This growth in adaptation comes at the cost of prohibitively large memory requirements and computational complexity, especially at higher number of input elements. This limitation is due to inherently limited data reuse opportunities and quadratic growth in memory footprints, leading to severe memory-boundedness and limited scalability of input elements. This work addresses these challenges by devising a tailored dataflow optimization, called FLAT, for attention mechanisms without altering their functionality. This dataflow processes costly attention operations through a unique fusion mechanism, transforming the memory footprint quadratic growth to merely a linear one. To realize the full potential of this bespoke mechanism, we propose a tiling approach to enhance the data reuse across attention operations. Our method both mitigates the off-chip bandwidth bottleneck as well as reduces the on-chip memory requirement. FLAT delivers 1.94x (1.76x) speedup and 49% and (42%) of energy savings compared to the state-of-the-art Edge (Cloud) accelerators with no customized dataflow optimization. When on-chip resources are scarce (20 KB-200 KB), FLAT yields, on average, 1.5x end-to-end latency reduction across a diverse range of conventional attention-based models with input sequence lengths ranging from 512-token to 64K-token. Our evaluations demonstrate that state-of-the-art DNN dataflow applied to attention operations reach the efficiency limit for inputs above 512 elements. In contrast, FLAT unblocks transformer models for inputs with up to 64K elements


title: Complexity and Second Moment of the Mathematical Theory of Communication

abstract: The performance of an error correcting code is evaluated by its error probability, rate, and en/decoding complexity. The performance of a series of codes is evaluated by, as the block lengths approach infinity, whether their error probabilities decay to zero, whether their rates converge to capacity, and whether their growth in complexities stays under control. Over any discrete memoryless channel, I build codes such that: (1) their error probabilities and rates scale like random codes; and (2) their en/decoding complexities scale like polar codes. Quantitatively, for any constants $p,r>0$ s.t. $p+2r<1$, I construct a series of codes with block length $N$ approaching infinity, error probability $\exp(-N^p)$, rate $N^{-r}$ less than the capacity, and en/decoding complexity $O(N\log N)$ per block. Over any discrete memoryless channel, I also build codes such that: (1) they achieve capacity rapidly; and (2) their en/decoding complexities outperform all known codes over non-BEC channels. Quantitatively, for any constants $t,r>0$ s.t. $2r<1$, I construct a series of codes with block length $N$ approaching infinity, error probability $\exp(-(\log N)^t)$, rate $N^{-r}$ less than the capacity, and en/decoding complexity $O(N\log(\log N))$ per block. The two aforementioned results are built upon two pillars: a versatile framework that generates codes on the basis of channel polarization, and a calculus-probability machinery that evaluates the performances of codes. The framework that generates codes and the machinery that evaluates codes can be extended to many other scenarios in network information theory. To name a few: lossless compression, lossy compression, Slepian-Wolf, Wyner-Ziv, multiple access channel, wiretap channel, and broadcast channel. In each scenario, the adapted notions of error probability and rate approach their limits at the same paces as specified above.


title: Analytic non-Abelian gravitating solitons in the Einstein-Yang-Mills-Higgs theory and transitions between them

abstract: Two analytic examples of globally regular non-Abelian gravitating solitons in the Einstein-Yang-Mills-Higgs theory in (3+1)-dimensions are presented. In both cases, the space-time geometries are of the Nariai type and the Yang-Mills field is completely regular and of meron type (namely, proportional to a pure gauge). However, while in the first family (type I) $X_{0} = 1/2$ (as in all the known examples of merons available so far) and the Higgs field is trivial, in the second family (type II) $X_{0}$ is not 1/2 and the Higgs field is non-trivial. We compare the entropies of type I and type II families determining when type II solitons are favored over type I solitons: the VEV of the Higgs field plays a crucial role in determining the phases of the system. The Klein-Gordon equation for test scalar fields coupled to the non-Abelian fields of the gravitating solitons can be written as the sum of a two-dimensional D'Alembert operator plus a Hamiltonian which has been proposed in the literature to describe the four-dimensional Quantum Hall Effect (QHE): the difference between type I and type II solutions manifest itself in a difference between the degeneracies of the corresponding energy levels.


title: High Phase-Space Density of Laser-Cooled Molecules in an Optical Lattice

abstract: We report laser cooling and trapping of yttrium monoxide (YO) molecules in an optical lattice. We show that gray molasses cooling remains exceptionally efficient for YO molecules inside the lattice with a molecule temperature as low as 6.1(6) $\mu$K. This approach has produced a trapped sample of 1200 molecules, with a peak spatial density of $\sim1.2\times10^{10}$ cm$^{-3}$, and a peak phase-space density of $\sim3.1\times10^{-6}$. By adiabatically ramping down the lattice depth, we cool the molecules further to 1.0(2) $\mu$K, twenty times colder than previously reported for laser-cooled molecules in a trap.


title: Learning to Recommend Items to Wikidata Editors

abstract: Wikidata is an open knowledge graph built by a global community of volunteers. As it advances in scale, it faces substantial challenges around editor engagement. These challenges are in terms of both attracting new editors to keep up with the sheer amount of work and retaining existing editors. Experience from other online communities and peer-production systems, including Wikipedia, suggests that personalised recommendations could help, especially newcomers, who are sometimes unsure about how to contribute best to an ongoing effort. For this reason, we propose a recommender system WikidataRec for Wikidata items. The system uses a hybrid of content-based and collaborative filtering techniques to rank items for editors relying on both item features and item-editor previous interaction. A neural network, named a neural mixture of representations, is designed to learn fine weights for the combination of item-based representations and optimize them with editor-based representation by item-editor interaction. To facilitate further research in this space, we also create two benchmark datasets, a general-purpose one with 220,000 editors responsible for 14 million interactions with 4 million items and a second one focusing on the contributions of more than 8,000 more active editors. We perform an offline evaluation of the system on both datasets with promising results. Our code and datasets are available at https://github.com/WikidataRec-developer/Wikidata_Recommender.


title: Tourbillon: a Physically Plausible Neural Architecture

abstract: In a physical neural system, backpropagation is faced with a number of obstacles including: the need for labeled data, the violation of the locality learning principle, the need for symmetric connections, and the lack of modularity. Tourbillon is a new architecture that addresses all these limitations. At its core, it consists of a stack of circular autoencoders followed by an output layer. The circular autoencoders are trained in self-supervised mode by recirculation algorithms and the top layer in supervised mode by stochastic gradient descent, with the option of propagating error information through the entire stack using non-symmetric connections. While the Tourbillon architecture is meant primarily to address physical constraints, and not to improve current engineering applications of deep learning, we demonstrate its viability on standard benchmark datasets including MNIST, Fashion MNIST, and CIFAR10. We show that Tourbillon can achieve comparable performance to models trained with backpropagation and outperform models that are trained with other physically plausible algorithms, such as feedback alignment.


title: Supersolid phase of a spin-orbit-coupled Bose-Einstein condensate: a perturbation approach

abstract: The phase diagram of a Bose-Einstein condensate with Raman-induced spin-orbit coupling includes a stripe phase with supersolid features. In this work we develop a perturbation approach to study the ground state and the Bogoliubov modes of this phase, holding for small values of the Raman coupling. We obtain analytical predictions for the most relevant observables (including the periodicity of stripes, sound velocities, compressibility, and magnetic susceptibility) which are in excellent agreement with the exact (non perturbative) numerical results, obtained for significantly large values of the coupling. We further unveil the nature of the two gapless Bogoliubov modes in the long-wavelength limit. We find that the spin branch of the spectrum, corresponding in this limit to the dynamics of the relative phase between the two spin components, describes a translation of the fringes of the equilibrium density profile, thereby providing the crystal Goldstone mode typical of a supersolid configuration. Finally, using sum-rule arguments, we show that the superfluid density can be experimentally accessed by measuring the ratio of the sound velocities parallel and perpendicular to the direction of the spin-orbit coupling.


title: TSCAN : Dialog Structure discovery using SCAN

abstract: Can we discover dialog structure by dividing utterances into labelled clusters. Can these labels be generated from the data. Typically for dialogs we need an ontology and use that to discover structure, however by using unsupervised classification and self-labelling we are able to intuit this structure without any labels or ontology. In this paper we apply SCAN (Semantic Clustering using Nearest Neighbors) to dialog data. We used BERT for pretext task and an adaptation of SCAN for clustering and self labeling. These clusters are used to identify transition probabilities and create the dialog structure. The self-labelling method used for SCAN makes these structures interpretable as every cluster has a label. As the approach is unsupervised, evaluation metrics is a challenge, we use statistical measures as proxies for structure quality


title: Sequential Recommendation for Cold-start Users with Meta Transitional Learning

abstract: A fundamental challenge for sequential recommenders is to capture the sequential patterns of users toward modeling how users transit among items. In many practical scenarios, however, there are a great number of cold-start users with only minimal logged interactions. As a result, existing sequential recommendation models will lose their predictive power due to the difficulties in learning sequential patterns over users with only limited interactions. In this work, we aim to improve sequential recommendation for cold-start users with a novel framework named MetaTL, which learns to model the transition patterns of users through meta-learning. Specifically, the proposed MetaTL: (i) formulates sequential recommendation for cold-start users as a few-shot learning problem; (ii) extracts the dynamic transition patterns among users with a translation-based architecture; and (iii) adopts meta transitional learning to enable fast learning for cold-start users with only limited interactions, leading to accurate inference of sequential interactions.


title: For high-dimensional hierarchical models, consider exchangeability of effects across covariates instead of across datasets

abstract: Hierarchical Bayesian methods enable information sharing across multiple related regression problems. While standard practice is to model regression parameters (effects) as (1) exchangeable across datasets and (2) correlated to differing degrees across covariates, we show that this approach exhibits poor statistical performance when the number of covariates exceeds the number of datasets. For instance, in statistical genetics, we might regress dozens of traits (defining datasets) for thousands of individuals (responses) on up to millions of genetic variants (covariates). When an analyst has more covariates than datasets, we argue that it is often more natural to instead model effects as (1) exchangeable across covariates and (2) correlated to differing degrees across datasets. To this end, we propose a hierarchical model expressing our alternative perspective. We devise an empirical Bayes estimator for learning the degree of correlation between datasets. We develop theory that demonstrates that our method outperforms the classic approach when the number of covariates dominates the number of datasets, and corroborate this result empirically on several high-dimensional multiple regression and classification problems.


title: Closure mechanism of the A1 and A2 modes in jet screech

abstract: This paper explores the screech closure mechanism for different axisymmetric modes in shock-containing jets. While many of the discontinuities in tonal frequency exhibited by screeching jets can be associated with a change in the azimuthal mode, there has to date been no explanation for the existence of multiple axisymmetric modes at different frequencies. This paper provides just such an explanation. As shown in previous works, specific wavenumbers arise from the interaction of waves in the flow with the shocks. This provides new paths for driving upstream-travelling waves that can potentially close the resonance loop. Predictions using locally parallel and spatially periodic linear stability analyses and the wavenumber spectrum of the shock-cell structure suggest that the A1 mode resonance is closed by a wave generated when the Kelvin-Helmholtz mode interacts with the leading wavenumber of the shock-cell structure. The A2 mode is closed by a wave that arises due to interaction between the Kelvin-Helmholtz wave and a secondary wavenumber peak, which arises from the spatial variation of the shock-cell wavelength. The predictions are shown to closely match experimental data, and possible justifications for the dominance of each mode are provided based on the growth rates of the absolute instability.


title: High resolution spectroscopic follow-up of the most metal-poor candidates from SkyMapper DR1.1

abstract: We present chemical abundances for 21 elements (from Li to Eu) in 150 metal-poor Galactic stars spanning $-$4.1 $<$ [Fe/H] $<$ $-$2.1. The targets were selected from the SkyMapper survey and include 90 objects with [Fe/H] $\le$ $-$3 of which some 15 have [Fe/H] $\le$ $-$3.5. When combining the sample with our previous studies, we find that the metallicity distribution function has a power-law slope of $\Delta$(log N)/$\Delta$[Fe/H] = 1.51 $\pm$ 0.01 dex per dex over the range $-$4 $\le$ [Fe/H] $\le$ $-$3. With only seven carbon-enhanced metal-poor stars in the sample, we again find that the selection of metal-poor stars based on SkyMapper filters is biased against highly carbon rich stars for [Fe/H] $>$ $-$3.5. Of the 20 objects for which we could measure nitrogen, 11 are nitrogen-enhanced metal-poor stars. Within our sample, the high NEMP fraction (55\% $\pm$ 21\%) is compatible with the upper range of predicted values (between 12\% and 35\%). The chemical abundance ratios [X/Fe] versus [Fe/H] exhibit similar trends to previous studies of metal-poor stars and Galactic chemical evolution models. We report the discovery of nine new r-I stars, four new r-II stars, one of which is the most metal-poor known, nine low-$\alpha$ stars with [$\alpha$/Fe] $\le$ 0.15 as well as one unusual star with [Zn/Fe] = +1.4 and [Sr/Fe] = +1.2 but with normal [Ba/Fe]. Finally, we combine our sample with literature data to provide the most extensive view of the early chemical enrichment of the Milky Way Galaxy.


title: Search for axion-like particles with electron and positron beams at KEK Linac

abstract: We propose a fixed-target experiment to search for Axion-like particles (ALPs) coupling to photons, which utilizes electron and positron beams available at KEK Linac. The sensitivity to ALP is evaluated for two shielding setups in conjunction with other beam dump experiments, fixed-target experiments, and $e^+e^-$ collider experiments. This study shows that the two setups can explore the gap between the search region excluded by the beam dump experiments and the $e^+e^-$ collider experiments.


title: Isogeny classes and endomorphisms algebras of abelian varieties over finite fields

abstract: We construct non-isogenous simple ordinary abelian varieties over an algebraic closure of a finite field with isomorphic endomorphism algebras.


title: A New Parallel Algorithm for Sinkhorn Word-Movers Distance and Its Performance on PIUMA and Xeon CPU

abstract: The Word Movers Distance (WMD) measures the semantic dissimilarity between two text documents by computing the cost of optimally moving all words of a source/query document to the most similar words of a target document. Computing WMD between two documents is costly because it requires solving an $O(V^3log(V))$ optimization problem where $V$ is the number of unique words in the document. Fortunately, WMD can be framed as an Earth Mover's Distance (EMD) for which the algorithmic complexity can be reduced to $O(V^2)$ by adding an entropy penalty to the optimization problem and solving it using the Sinkhorn-Knopp algorithm. Additionally, the computation can be made highly parallel by adopting a batching approach, i.e., computing the WMD of a single query document against multiple target documents at once. Sinkhorn WMD is a key kernel used in many ML/NLP applications. and usually gets implemented in Python. However, a straightforward Python implementation may leave significant performance on the table even though it may internally call optimized C++ BLAS routines. We present a new sparse {P}arallel {A}lgorithm for {S}inkhorn-Knopp {W}ord-movers {D}istance to compute the semantic distance of one document to many other documents by adopting the $O(V^2)$ EMD algorithm. We algorithmically transform $O(V^2)$ dense compute-heavy EMD version into an equivalent sparse one using new fused SDDMM-SpMM (sparse selection of dense-dense matrix-, sparse-dense matrix-multiplication) kernels. We implemented and optimized this algorithm for two very different architectures -- the new Intel Programmable Integrated Unified Memory Architecture (PIUMA) and Intel Xeon CPUs. We show that we were able to reach close to peak performance on both platforms.


title: Centralized Model and Exploration Policy for Multi-Agent RL

abstract: Reinforcement learning (RL) in partially observable, fully cooperative multi-agent settings (Dec-POMDPs) can in principle be used to address many real-world challenges such as controlling a swarm of rescue robots or a team of quadcopters. However, Dec-POMDPs are significantly harder to solve than single-agent problems, with the former being NEXP-complete and the latter, MDPs, being just P-complete. Hence, current RL algorithms for Dec-POMDPs suffer from poor sample complexity, which greatly reduces their applicability to practical problems where environment interaction is costly. Our key insight is that using just a polynomial number of samples, one can learn a centralized model that generalizes across different policies. We can then optimize the policy within the learned model instead of the true system, without requiring additional environment interactions. We also learn a centralized exploration policy within our model that learns to collect additional data in state-action regions with high model uncertainty. We empirically evaluate the proposed model-based algorithm, MARCO, in three cooperative communication tasks, where it improves sample efficiency by up to 20x. Finally, to investigate the theoretical sample complexity, we adapt an existing model-based method for tabular MDPs to Dec-POMDPs, and prove that it achieves polynomial sample complexity.


title: Semi-Random Impossibilities of Condorcet Criterion

abstract: The Condorcet criterion (CC) is a classical and well-accepted criterion for voting. Unfortunately, it is incompatible with many other desiderata including participation (Par), half-way monotonicity (HM), Maskin monotonicity (MM), and strategy-proofness (SP). Such incompatibilities are often known as impossibility theorems, and are proved by worst-case analysis. Previous work has investigated the likelihood for these impossibilities to occur under certain models, which are often criticized of being unrealistic. We strengthen previous work by proving the first set of semi-random impossibilities for voting rules to satisfy CC and the more general, group versions of the four desiderata: for any sufficiently large number of voters $n$, any size of the group $1\le B\le \sqrt n$, any voting rule $r$, and under a large class of {\em semi-random} models that include Impartial Culture, the likelihood for $r$ to satisfy CC and Par, CC and HM, CC and MM, or CC and SP is $1-\Omega(\frac{B}{\sqrt n})$. This matches existing lower bounds for CC and Par ($B=1$) and CC and SP ($B\le \sqrt n$), showing that many commonly-studied voting rules are already asymptotically optimal in such cases.


title: Bayesian Semiparametric Multivariate Density Deconvolution via Stochastic Rotation of Replicates

abstract: We consider the problem of multivariate density deconvolution where the distribution of a random vector needs to be estimated from replicates contaminated with conditionally heteroscedastic measurement errors. We propose a conceptually straightforward yet fundamentally novel and highly robust approach to multivariate density deconvolution by stochastically rotating the replicates toward the corresponding true latent values. We also address the additionally significantly challenging problem of accommodating conditionally heteroscedastic measurement errors in this newly introduced framework. We take a Bayesian route to estimation and inference, implemented via an efficient Markov chain Monte Carlo algorithm, appropriately accommodating uncertainty in all aspects of our analysis. Asymptotic convergence guarantees for the method are also established. We illustrate the method's empirical efficacy through simulation experiments and its practical utility in estimating the long-term joint average intakes of different dietary components from their measurement error contaminated 24-hour dietary recalls.


title: Distance in Latin Squares

abstract: A Latin square of order $n$ is an $n\times n$ array which contains $n$ distinct symbols exactly once in each row and column. We define the adjacent distance between two adjacent cells (containing integers) to be their difference modulo $n$, and inner distance of a Latin square to be the minimum of adjacent distances in the Latin square. By first establishing upper bounds and then constructing squares with said inner distance, we found the maximum inner distance of an $n \times n$ Latin square to be $\left\lfloor\frac{n-1}{2}\right\rfloor$. We then studied special kinds of Latin squares such as pandiagonals (also known as Knut-Vik designs), as well as Sudoku Latin squares. This research was conducted at the REU at Moravian College on Research Challenges of Computational and Experimental Mathematics, with support from the National Science Foundation.


title: Generalized Kn\"{o}rrer's Periodicity Theorem

abstract: Let $A$ be a noetherian Koszul Artin-Schelter regular algebra, and let $f\in A_2$ be a central regular element of $A$. The quotient algebra $A/(f)$ is usually called a (noncommutative) quadric hypersurface. In this paper, we use the Clifford deformation to study the quadric hypersurfaces obtained from the tensor products. We introduce a notion of simple graded isolated singularity and proved that, if $B/(g)$ is a simple graded isolated singularity of 0-type, then there is an equivalence of triangulated categories $\underline{\text{mcm}}\,A/(f)\cong\underline{\text{mcm}}\,(A\otimes B)/(f+g)$ of the stable categories of maximal Cohen-Macaulay modules. This result may be viewed as a generalization of Kn\"{o}rrer's periodicity theorem. As an application, we study the double branch cover $(A/(f))^\#=A[x]/(f+x^2)$ of a noncommutative conic $A/(f)$.


title: Sequence Engineering of Copolymers using Evolutionary Computing

abstract: The correlations between the sequence of monomers in a polymer and its three-dimensional structure is a grand challenge in polymer science and biology. The properties and functions of macromolecules depend on their 3D shape that has appeared to be dictated by their monomer sequence. However, the progress towards understanding the sequence-structure-property correlations and their utilization in materials engineering are slow because it is almost impossible to characterize astronomically large number of possible sequences of a copolymer using traditional experimental and simulation methods. To address this problem, here, we combine evolutionary computing and coarse-grained molecular dynamics simulation and study the sequence-structure correlations of a model AB type copolymer system. The CGMD based evolutionary algorithm screens the sequence space of the copolymer efficiently and identifies wide range of single molecule structures including extremal radius of gyrations. The data provide new insights on the sequence-Rg correlations of the copolymer system and their impact on the structure and functionality of polymeric materials. The work highlights the opportunities of sequence specific control of macromolecular structure for designing materials with exceptional properties.


title: Trellis BMA: Coded Trace Reconstruction on IDS Channels for DNA Storage

abstract: Sequencing a DNA strand, as part of the read process in DNA storage, produces multiple noisy copies which can be combined to produce better estimates of the original strand; this is called trace reconstruction. One can reduce the error rate further by introducing redundancy in the write sequence and this is called coded trace reconstruction. In this paper, we model the DNA storage channel as an insertion-deletion-substitution (IDS) channel and design both encoding schemes and low-complexity decoding algorithms for coded trace reconstruction. We introduce Trellis BMA, a new reconstruction algorithm whose complexity is linear in the number of traces, and compare its performance to previous algorithms. Our results show that it reduces the error rate on both simulated and experimental data. The performance comparisons in this paper are based on a new dataset of traces that will be publicly released with the paper. Our hope is that this dataset will enable research progress by allowing objective comparisons between candidate algorithms.


title: Neutron skin thickness of $^{208}$Pb, $^{116,120,124}$Sn, and $^{40}$Ca determined from reaction cross sections of $^{4}$He scattering

abstract: [Background] We constructed the Kyushu chiral $g$-matrix and confirmed its reliability at $30 \lesssim E_{\rm in} \lesssim 100 $~MeV and $250 \lesssim E_{\rm in} \lesssim 400$~MeV for $^{12}$C scattering. Reaction cross section data of $^{4}$He scattering are available for some nuclides including $^{208}$Pb. PREX II collaboration reported a thick neutron skin for $^{208}$Pb. [Purpose] Our purpose is to deduce neutron skin thicknesses of $^{208}$Pb and some other nuclides from reaction cross sections calculated in terms of the double folding model with the $g$-matrix. [Methods] We fold the $g$-matrix and densities given by mean field calculations. In order to remedy less-constrainedness of the neutron sector, we renormalize densities so as to reproduce the observed cross sections. [Results] We found that a 3.4~$\%$ renormalization is necessary for $^{208}$Pb. The neutron density obtained from renormalization results in $R_{\rm skin}=$ 0.416$\pm$0.146 fm by confronting the precision proton radius. [Conclusions] Our result is consistent with PREX II and therefore supports larger slope parameter $L$. Results for $^{40}$Ca and $^{124}$Sn are also consistent with $R_{\rm skin}$ deduced from other experiments. For $^{116,120}$Sn the present method gives thicker skins.


title: GREN: Graph-Regularized Embedding Network for Weakly-Supervised Disease Localization in X-ray Images

abstract: Locating diseases in chest X-ray images with few careful annotations saves large human effort. Recent works approached this task with innovative weakly-supervised algorithms such as multi-instance learning (MIL) and class activation maps (CAM), however, these methods often yield inaccurate or incomplete regions. One of the reasons is the neglection of the pathological implications hidden in the relationship across anatomical regions within each image and the relationship across images. In this paper, we argue that the cross-region and cross-image relationship, as contextual and compensating information, is vital to obtain more consistent and integral regions. To model the relationship, we propose the Graph Regularized Embedding Network (GREN), which leverages the intra-image and inter-image information to locate diseases on chest X-ray images. GREN uses a pre-trained U-Net to segment the lung lobes, and then models the intra-image relationship between the lung lobes using an intra-image graph to compare different regions. Meanwhile, the relationship between in-batch images is modeled by an inter-image graph to compare multiple images. This process mimics the training and decision-making process of a radiologist: comparing multiple regions and images for diagnosis. In order for the deep embedding layers of the neural network to retain structural information (important in the localization task), we use the Hash coding and Hamming distance to compute the graphs, which are used as regularizers to facilitate training. By means of this, our approach achieves the state-of-the-art result on NIH chest X-ray dataset for weakly-supervised disease localization. Our codes are accessible online (https://github.com/qibaolian/GREN).


title: Magnetic order and its interplay with structure phase transition in van der Waals ferromagnet VI$_3$

abstract: Van der Waals magnet VI$_3$ demonstrates intriguing magnetic properties that render it great for use in various applications. However, its microscopic magnetic structure has not been determined yet. Here, we report neutron diffraction and susceptibility measurements in VI$_3$ that revealed a ferromagnetic order with the moment direction tilted from the $c$-axis by ~36{\deg} at 4 K. A spin reorientation accompanied by a structure distortion within the honeycomb plane is observed at a temperature of ~27 K, before the magnetic order completely disappears at $T_C$ = 50 K. The refined magnetic moment of ~1.3 $\mu_B$ at 4 K is considerably lower than the fully ordered spin moment of 2 $\mu_B$/ V$^{3+}$, suggesting the presence of a considerable orbital moment antiparallel to the spin moment and strong spin-orbit coupling in VI$_3$. This results in strong magnetoelastic interactions that make the magnetic properties of VI$_3$ easily tunable via strain and pressure.


title: Interaction decomposition for Hilbert spaces

abstract: The decomposition into interaction subspaces is an important result for graphical models and plays a central role for results on the linearized marginal problem; similarly the Chaos decomposition plays an important role in statistical physics at the thermodynamic limit and in probability theory in general. We unify and extend both constructions by defining and characterizing decomposable functors from a well-founded poset to the category of Hilbert spaces, completing previous work on decomposable collections of vector subspaces and presheaves.


title: MSFNet:Multi-scale features network for monocular depth estimation

abstract: In recent years, monocular depth estimation is applied to understand the surrounding 3D environment and has made great progress. However, there is an ill-posed problem on how to gain depth information directly from a single image. With the rapid development of deep learning, this problem is possible to be solved. Although more and more approaches are proposed one after another, most of existing methods inevitably lost details due to continuous downsampling when mapping from RGB space to depth space. To the end, we design a Multi-scale Features Network (MSFNet), which consists of Enhanced Diverse Attention (EDA) module and Upsample-Stage Fusion (USF) module. The EDA module employs the spatial attention method to learn significant spatial information, while USF module complements low-level detail information with high-level semantic information from the perspective of multi-scale feature fusion to improve the predicted effect. In addition, since the simple samples are always trained to a better effect first, the hard samples are difficult to converge. Therefore, we design a batch-loss to assign large loss factors to the harder samples in a batch. Experiments on NYU-Depth V2 dataset and KITTI dataset demonstrate that our proposed approach is more competitive with the state-of-the-art methods in both qualitative and quantitative evaluation.


title: Hierarchical Associative Memory

abstract: Dense Associative Memories or Modern Hopfield Networks have many appealing properties of associative memory. They can do pattern completion, store a large number of memories, and can be described using a recurrent neural network with a degree of biological plausibility and rich feedback between the neurons. At the same time, up until now all the models of this class have had only one hidden layer, and have only been formulated with densely connected network architectures, two aspects that hinder their machine learning applications. This paper tackles this gap and describes a fully recurrent model of associative memory with an arbitrary large number of layers, some of which can be locally connected (convolutional), and a corresponding energy function that decreases on the dynamical trajectory of the neurons' activations. The memories of the full network are dynamically "assembled" using primitives encoded in the synaptic weights of the lower layers, with the "assembling rules" encoded in the synaptic weights of the higher layers. In addition to the bottom-up propagation of information, typical of commonly used feedforward neural networks, the model described has rich top-down feedback from higher layers that help the lower-layer neurons to decide on their response to the input stimuli.

categories: cs.NE cond-mat.dis-nn cs.LG q-bio.NC stat.ML


title: Irreducibility of the Bloch Variety for Finite-Range Schr\"odinger Operators

abstract: We study the Bloch variety of discrete Schr\"odinger operators associated with a complex periodic potential and a general finite-range interaction, showing that the Bloch variety is irreducible for a wide class of lattice geometries in arbitrary dimension. Examples include the triangular lattice and the extended Harper lattice.


title: Survey data integration for regression analysis using model calibration

abstract: We consider regression analysis in the context of data integration. To combine partial information from external sources, we employ the idea of model calibration which introduces a "working" reduced model based on the observed covariates. The working reduced model is not necessarily correctly specified but can be a useful device to incorporate the partial information from the external data. The actual implementation is based on a novel application of the information projection and model calibration weighting. The proposed method is particularly attractive for combining information from several sources with different missing patterns. The proposed method is applied to a real data example combining survey data from Korean National Health and Nutrition Examination Survey and big data from National Health Insurance Sharing Service in Korea.


title: End-to-end Ultrasound Frame to Volume Registration

abstract: Fusing intra-operative 2D transrectal ultrasound (TRUS) image with pre-operative 3D magnetic resonance (MR) volume to guide prostate biopsy can significantly increase the yield. However, such a multimodal 2D/3D registration problem is a very challenging task. In this paper, we propose an end-to-end frame-to-volume registration network (FVR-Net), which can efficiently bridge the previous research gaps by aligning a 2D TRUS frame with a 3D TRUS volume without requiring hardware tracking. The proposed FVR-Net utilizes a dual-branch feature extraction module to extract the information from TRUS frame and volume to estimate transformation parameters. We also introduce a differentiable 2D slice sampling module which allows gradients backpropagating from an unsupervised image similarity loss for content correspondence learning. Our model shows superior efficiency for real-time interventional guidance with highly competitive registration accuracy.


title: Existence of optimizers in a Sobolev inequality for vector fields

abstract: We consider the minimization problem corresponding to a Sobolev inequality for vector fields and show that minimizing sequences are relatively compact up to the symmetries of the problem. In particular, there is a minimizer. An ingredient in our proof is a version of the Rellich--Kondrachov compactness theorem for sequences satisfying a nonlinear constraint.


title: The Lunar Geophysical Network Landing Sites Science Rationale

abstract: The Lunar Geophysical Network (LGN) mission is proposed to land on the Moon in 2030 and deploy packages at four locations to enable geophysical measurements for 6-10 years. Returning to the lunar surface with a long-lived geophysical network is a key next step to advance lunar and planetary science. LGN will greatly expand our primarily Apollo-based knowledge of the deep lunar interior by identifying and characterizing mantle melt layers, as well as core size and state. To meet the mission objectives, the instrument suite provides complementary seismic, geodetic, heat flow, and electromagnetic observations. We discuss the network landing site requirements and provide example sites that meet these requirements. Landing site selection will continue to be optimized throughout the formulation of this mission. Possible sites include the P-5 region within the Procellarum KREEP Terrane (PKT; (lat:$15^{\circ}$; long:$-35^{\circ}$), Schickard Basin (lat:$-44.3^{\circ}$; long:$-55.1^{\circ}$), Crisium Basin (lat:$18.5^{\circ}$; long:$61.8^{\circ}$), and the farside Korolev Basin (lat:$-2.4^{\circ}$; long:$-159.3^{\circ}$). Network optimization considers the best locations to observe seismic core phases, e.g., ScS and PKP. Ray path density and proximity to young fault scarps are also analyzed to provide increased opportunities for seismic observations. Geodetic constraints require the network to have at least three nearside stations at maximum limb distances. Heat flow and electromagnetic measurements should be obtained away from terrane boundaries and from magnetic anomalies at locations representative of global trends. An in-depth case study is provided for Crisium. In addition, we discuss the consequences for scientific return of less than optimal locations or number of stations.


title: Nucleon-nucleon potentials from Delta-full chiral effective-field-theory and implications

abstract: We closely investigate NN potentials based upon the Delta-full version of chiral effective field theory. We find that recently constructed NN potentials of this kind, which (when applied together with three-nucleon forces) were presented as predicting accurate binding energies and radii for a range of nuclei from A=16 to A=132 and providing accurate equations of state for nuclear matter, yield a chi^2/datum of 60 for the reproduction of the pp data below 100 MeV laboratory energy. This chi^2 is more than three times what the Hamada-Johnston potential of the year of 1962 achieved already some 60 years ago. We perceive this historical fact as concerning in view of the current emphasis on precision. We are able to trace the very large chi^2 as well as the apparent success of the potentials in nuclear structure to unrealistic predictions for P-wave states, in which the Delta-full NNLO potentials are off by up to 40 times the NNLO truncation errors. In fact, we show that, the worse the description of the P-wave states, the better the predictions in nuclear structure. Thus, these potentials cannot be seen as the solution to the outstanding problems in current miscroscopic nuclear structure physics.


title: Enhanced dissipation for the third component of 3D anisotropic Navier-Stokes equations

abstract: In this paper, we study the decay rates for the global small smooth solutions to 3D anisotropic incompressible Navier-Stokes equations. In particular, we prove that the horizontal components of the velocity field decay like the solutions of 2D classical Navier-Stokes equations. While the third component of the velocity field decays as the solutions of 3D Navier-Stokes equations. We remark that such enhanced decay rate for the third component is caused by the interplay between the divergence free condition of the velocity field and the horizontal Laplacian in the anisotropic Navier-Stokes equations.


title: Approximate trace reconstruction of random strings from a constant number of traces

abstract: In the trace reconstruction problem, the goal is to reconstruct an unknown string $x$ of length $n$ from multiple traces obtained by passing $x$ through the deletion channel. In the relaxed problem of $approximate$ trace reconstruction, the goal is to reconstruct an approximation $\widehat{x}$ of $x$ which is close (within $\epsilon n$) to $x$ in edit distance. We show that for most strings $x$, this is possible with high probability using only a constant number of traces. Crucially, this constant does not grow with $n$, and only depends on the deletion probability and $\epsilon$.


title: Zentropy Theory for Positive and Negative Thermal Expansions

abstract: It has been observed in both natural and man-made materials that volume sometimes decreases with increasing temperature. Though mechanistic understanding has been gained for some individual materials, a general answer to the question "Why does volume sometimes decrease with the increase of temperature?" remains lacking. Based on the thermodynamic relation that the derivative of volume with respect to temperature, i.e., thermal expansion, is equal to the negative derivative of entropy with respect to pressure, we developed a general theory in terms of multiscale entropy to understand and predict the change of volume as a function of temperature, which is termed as zentropy theory in the present work. It is shown that a phase at high temperatures is a statistical representation of the ground-state stable and multiple nonground-state metastable configurations. It is demonstrated that when the volumes of the major nonground-state configurations are smaller than that of the ground-state configuration, the volume of the phase may decrease with the increase of temperature in certain ranges of temperature-pressure combinations, depicting the negative divergency of thermal expansion at the critical point. As examples, positive and negative divergencies of thermal expansion are predicted at the critical points of Ce and Fe3Pt, respectively, along with the temperature and pressure ranges for abnormally positive and negative thermal expansion. The authors believe that the zentropy theory is applicable to predict anomalies of other physical properties of phases because the change of entropy drives the responses of a system to external stimuli.


title: AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense

abstract: We propose an AID-purifier that can boost the robustness of adversarially-trained networks by purifying their inputs. AID-purifier is an auxiliary network that works as an add-on to an already trained main classifier. To keep it computationally light, it is trained as a discriminator with a binary cross-entropy loss. To obtain additionally useful information from the adversarial examples, the architecture design is closely related to information maximization principles where two layers of the main classification network are piped to the auxiliary network. To assist the iterative optimization procedure of purification, the auxiliary network is trained with AVmixup. AID-purifier can be used together with other purifiers such as PixelDefend for an extra enhancement. The overall results indicate that the best performing adversarially-trained networks can be enhanced by the best performing purification networks, where AID-purifier is a competitive candidate that is light and robust.


title: Dirichlet Series Under Standard Convolutions: Variations on Ramanujan's Identity for Odd Zeta Values

abstract: Inspired by a famous identity of Ramanujan, we propose a general formula linearizing the convolution of Dirichlet series as the sum of Dirichlet series with modified weights; its specialization produces new identities and recovers several identities derived earlier in the literature, such as the convolution of squares of Bernoulli numbers by A. Dixit and collaborators, or the convolution of Bernoulli numbers by Y. Komori and collaborators.


title: Free boundary constant mean curvature surfaces in a strictly convex three-manifold

abstract: Let $C$ be a strictly convex domain in a $3$-dimensional Riemannian manifold with sectional curvature bounded above by a constant and let $\Sigma$ be a constant mean curvature surface with free boundary in $C$. We provide a pinching condition on the length of the traceless second fundamental form on $\Sigma$ which guarantees that the surface is homeomorphic to either a disk or an annulus. Furthermore, under the same pinching condition, we prove that if $C$ is a geodesic ball of $3$-dimensional space forms, then $\Sigma$ is either a spherical cap or a Delaunay surface.


title: Adaptive Two-Layer ReLU Neural Network: II. Ritz Approximation to Elliptic PDEs

abstract: In this paper, we study adaptive neuron enhancement (ANE) method for solving self-adjoint second-order elliptic partial differential equations (PDEs). The ANE method is a self-adaptive method generating a two-layer spline NN and a numerical integration mesh such that the approximation accuracy is within the prescribed tolerance. Moreover, the ANE method provides a natural process for obtaining a good initialization which is crucial for training nonlinear optimization problem. The underlying PDE is discretized by the Ritz method using a two-layer spline neural network based on either the primal or dual formulations that minimize the respective energy or complimentary functionals. Essential boundary conditions are imposed weakly through the functionals with proper norms. It is proved that the Ritz approximation is the best approximation in the energy norm; moreover, effect of numerical integration for the Ritz approximation is analyzed as well. Two estimators for adaptive neuron enhancement method are introduced, one is the so-called recovery estimator and the other is the least-squares estimator. Finally, numerical results for diffusion problems with either corner or intersecting interface singularities are presented.


title: A Unified Formula of the Optimal Portfolio for Piecewise Hyperbolic Absolute Risk Aversion Utilities

abstract: We propose a general family of piecewise hyperbolic absolute risk aversion (PHARA) utilities, including many classic and non-standard utilities as examples. A typical application is the composition of a HARA preference and a piecewise linear payoff in asset allocation. We derive a unified closed-form formula of the optimal portfolio, which is a four-term division. The formula has clear economic meanings, reflecting the behavior of risk aversion, risk seeking, loss aversion and first-order risk aversion. We conduct a general asymptotic analysis to the optimal portfolio, which directly serves as an analytical tool for financial analysis. We compare this PHARA portfolio with those of other utility families both analytically and numerically. One main finding is that risk-taking behaviors are greatly increased by non-concavity and reduced by non-differentiability of the PHARA utility. Finally, we use financial data to test the performance of the PHARA portfolio in the market.


title: Impact of Rotary-Wing UAV Wobbling on Millimeter-wave Air-to-Ground Wireless Channel

abstract: Millimeter-wave rotary-wing (RW) unmanned aerial vehicle (UAV) air-to-ground (A2G) links face unpredictable Doppler effect arising from the inevitable wobbling of RW UAV. Moreover, the time-varying channel characteristics during transmission lead to inaccurate channel estimation, which in turn results in the deteriorated bit error probability performance of the UAV A2G link. This paper studies the impact of mechanical wobbling on the Doppler effect of the millimeter-wave wireless channel between a hovering RW UAV and a ground node. Our contributions of this paper lie in: i) modeling the wobbling process of a hovering RW UAV; ii) developing an analytical model to derive the channel temporal autocorrelation function (ACF) for the millimeter-wave RW UAV A2G link in a closed-form expression; and iii) investigating how RW UAV wobbling impacts the Doppler effect on the millimeter-wave RW UAV A2G link. Numerical results show that different RW UAV wobbling patterns impact the amplitude and the frequency of ACF oscillation in the millimeter-wave RW UAV A2G link. For UAV wobbling, the channel temporal ACF decreases quickly and the impact of the Doppler effect is significant on the millimeter-wave A2G link.


title: Arcs Intersecting at Most Once on the 4-Punctured Sphere

abstract: We classify maximal systems of arcs which intersect at most once on the 4-punctured sphere.


title: Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

abstract: Recently deep learning-based image compression methods have achieved significant achievements and gradually outperformed traditional approaches including the latest standard Versatile Video Coding (VVC) in both PSNR and MS-SSIM metrics. Two key components of learned image compression are the entropy model of the latent representations and the encoding/decoding network architectures. Various models have been proposed, such as autoregressive, softmax, logistic mixture, Gaussian mixture, and Laplacian. Existing schemes only use one of these models. However, due to the vast diversity of images, it is not optimal to use one model for all images, even different regions within one image. In this paper, we propose a more flexible discretized Gaussian-Laplacian-Logistic mixture model (GLLMM) for the latent representations, which can adapt to different contents in different images and different regions of one image more accurately and efficiently, given the same complexity. Besides, in the encoding/decoding network design part, we propose a concatenated residual blocks (CRB), where multiple residual blocks are serially connected with additional shortcut connections. The CRB can improve the learning ability of the network, which can further improve the compression performance. Experimental results using the Kodak, Tecnick-100 and Tecnick-40 datasets show that the proposed scheme outperforms all the leading learning-based methods and existing compression standards including VVC intra coding (4:4:4 and 4:2:0) in terms of the PSNR and MS-SSIM. The source code is available at \url{https://github.com/fengyurenpingsheng}


title: A class of APcN power functions over finite fields of even characteristic

abstract: In this paper, we investigate the power functions $F(x)=x^d$ over the finite field $\mathbb{F}_{2^{4n}}$, where $n$ is a positive integer and $d=2^{3n}+2^{2n}+2^{n}-1$. It is proved that $F(x)=x^d$ is APcN at certain $c$'s in $\mathbb{F}_{2^{4n}}$, and it is the second class of APcN power functions over finite fields of even characteristic. Further, the $c$-differential spectrum of these power functions is also determined.


title: Comments on Quivers and Fractons

abstract: We discuss certain structural analogies between supersymmetric quiver gauge theories and lattice models leading to fracton phases of matter. In particular, classes of quiver models can be viewed as lattice models having sub-system symmetries, dimensions of moduli spaces growing linearly with the size of the lattice, and having excitations with limited mobility (with "excitations" and "mobility" properly defined).


title: Going Beyond Linear RL: Sample Efficient Neural Function Approximation

abstract: Deep Reinforcement Learning (RL) powered by neural net approximation of the Q function has had enormous empirical success. While the theory of RL has traditionally focused on linear function approximation (or eluder dimension) approaches, little is known about nonlinear RL with neural net approximations of the Q functions. This is the focus of this work, where we study function approximation with two-layer neural networks (considering both ReLU and polynomial activation functions). Our first result is a computationally and statistically efficient algorithm in the generative model setting under completeness for two-layer neural networks. Our second result considers this setting but under only realizability of the neural net function class. Here, assuming deterministic dynamics, the sample complexity scales linearly in the algebraic dimension. In all cases, our results significantly improve upon what can be attained with linear (or eluder dimension) methods.


title: Multi-Task Audio Source Separation

abstract: The audio source separation tasks, such as speech enhancement, speech separation, and music source separation, have achieved impressive performance in recent studies. The powerful modeling capabilities of deep neural networks give us hope for more challenging tasks. This paper launches a new multi-task audio source separation (MTASS) challenge to separate the speech, music, and noise signals from the monaural mixture. First, we introduce the details of this task and generate a dataset of mixtures containing speech, music, and background noises. Then, we propose an MTASS model in the complex domain to fully utilize the differences in spectral characteristics of the three audio signals. In detail, the proposed model follows a two-stage pipeline, which separates the three types of audio signals and then performs signal compensation separately. After comparing different training targets, the complex ratio mask is selected as a more suitable target for the MTASS. The experimental results also indicate that the residual signal compensation module helps to recover the signals further. The proposed model shows significant advantages in separation performance over several well-known separation models.


title: Sampling on NISQ Devices: "Who's the Fairest One of All?"

abstract: Modern NISQ devices are subject to a variety of biases and sources of noise that degrade the solution quality of computations carried out on these devices. A natural question that arises in the NISQ era, is how fairly do these devices sample ground state solutions. To this end, we run five fair sampling problems (each with at least three ground state solutions) that are based both on quantum annealing and on the Grover Mixer-QAOA algorithm for gate-based NISQ hardware. In particular, we use seven IBM~Q devices, the Aspen-9 Rigetti device, the IonQ device, and three D-Wave quantum annealers. For each of the fair sampling problems, we measure the ground state probability, the relative fairness of the frequency of each ground state solution with respect to the other ground state solutions, and the aggregate error as given by each hardware provider. Overall, our results show that NISQ devices do not achieve fair sampling yet. We also observe differences in the software stack with a particular focus on compilation techniques that illustrate what work will still need to be done to achieve a seamless integration of frontend (i.e. quantum circuit description) and backend compilation.


title: Model-Parallel Model Selection for Deep Learning Systems

abstract: As deep learning becomes more expensive, both in terms of time and compute, inefficiencies in machine learning (ML) training prevent practical usage of state-of-the-art models for most users. The newest model architectures are simply too large to be fit onto a single processor. To address the issue, many ML practitioners have turned to model parallelism as a method of distributing the computational requirements across several devices. Unfortunately, the sequential nature of neural networks causes very low efficiency and device utilization in model parallel training jobs. We propose a new form of "shard parallelism" combining task and model parallelism, then package it into a framework we name Hydra. Hydra recasts the problem of model parallelism in the multi-model context to produce a fine-grained parallel workload of independent model shards, rather than independent models. This new parallel design promises dramatic speedups relative to the traditional model parallelism paradigm.


title: On the $A_\alpha$ spectral radius and $A_\alpha$ energy of digraphs

abstract: Let $G$ be a digraph with adjacency matrix $A(G)$ and outdegrees diagonal matrix $D(G)$. For any real $\alpha\in[0,1]$, the $A_\alpha$ matrix $A_\alpha(G)$ of a digraph $G$ is defined as $A_\alpha(G)=\alpha D(G)+(1-\alpha)A(G)$. The eigenvalue of $A_\alpha(G)$ with the largest modulus is called the $A_\alpha$ spectral radius of $G$. In this paper, we first give some upper bounds for the $A_\alpha$ spectral radius of a digraph and we also characterize the extremal digraphs attaining these bounds. Moreover, we define the $A_\alpha$ energy of a digraph $G$ as $E^{A_\alpha}(G)=\sum\limits_{i=1}^n(\lambda^\alpha_i(G))^2$, where $n$ is the number of vertices and $\lambda^\alpha_i(G)$ $(i=1,2,\ldots,n)$ are the eigenvalues of $A_\alpha(G)$. We obtain a formula for $E^{A_\alpha}(G)$, and give a lower and upper bounds for $E^{A_\alpha}(G)$ and characterize the extremal digraphs that attain the lower and upper bounds. Finally, we characterize the extremal digraphs with maximum and minimum $A_\alpha$ energy among all directed trees and unicyclic digraphs, respectively.


title: A priori subcell limiting based on compact nonuniform nonlinear weighted schemes of high-order CPR method for hyperbolic conservation laws

abstract: This paper develops a shock capturing approach for high-order correction procedure via reconstruction (CPR) method with Legendre-Gauss solution points. Shock regions are treated by novel compact nonuniform nonlinear weighted (CNNW) schemes, which have the same solution points as the CPR method. CNNW schemes are constructed by discretizing flux derivatives based on Riemann fluxes at flux points in one cell and using nonuniform nonlinear weighted (NNW) interpolations to obtain the left and right values at flux points. Then, a priori subcell p-adaptive CNNW limiting of the CPR method is proposed for hyperbolic conservation laws. Firstly, a troubled cell indicator is used to detect shock regions and to quantify solution smoothness. Secondly, according to the magnitude of the indicator, CNNW schemes with varying accuracy orders are chosen adaptively for the troubled cells. The spectral property and discrete conservation laws are mathematically analyzed. Various numerical experiments show that the CPR method with subcell CNNW limiting has superiority in satisfying discrete conservation laws and in good balance between resolution and shock capturing robustness.


title: Linking Health News to Research Literature

abstract: Accurately linking news articles to scientific research works is a critical component in a number of applications, such as measuring the social impact of a research work and detecting inaccuracies or distortions in science news. Although the lack of links between news and literature has been a challenge in these applications, it is a relatively unexplored research problem. In this paper we designed and evaluated a new approach that consists of (1) augmenting latest named-entity recognition techniques to extract various metadata, and (2) designing a new elastic search engine that can facilitate the use of enriched metadata queries. To evaluate our approach, we constructed two datasets of paired news articles and research papers: one is used for training models to extract metadata, and the other for evaluation. Our experiments showed that the new approach performed significantly better than a baseline approach used by altmetric.com (0.89 vs 0.32 in terms of top-1 accuracy). To further demonstrate the effectiveness of the approach, we also conducted a study on 37,600 health-related press releases published on EurekAlert!, which showed that our approach was able to identify the corresponding research papers with a top-1 accuracy of at least 0.97.


title: Spectrum Gaussian Processes Based On Tunable Basis Functions

abstract: Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions, such as eigenvectors in the Hilbert space, in the spectrum method, or decoupled orthogonal components in the variational framework. In this paper, inspired by quantum physics, we introduce a novel basis function, which is tunable, local and bounded, to approximate the kernel function in the Gaussian process. There are two adjustable parameters in these functions, which control their orthogonality to each other and limit their boundedness. And we conduct extensive experiments on open-source datasets to testify its performance. Compared to several state-of-the-art methods, it turns out that the proposed method can obtain satisfactory or even better results, especially with poorly chosen kernel functions.


title: Algebraic theory of formal regular-singular connections with parameters

abstract: This paper is divided into two parts. The first is a review, through categorical lenses, of the classical theory of regular-singular differential systems over $C((x))$ and $\mathbb P^1_C\smallsetminus\{0,\infty\}$, where $C$ is algebraically closed and of characteristic zero. It aims at reading the existing classification results as an equivalence between regular-singular systems and representations of the group $\mathbb Z$. In the second part, we deal with regular-singular connections over $R((x))$ and $\mathbb P_R^1\smallsetminus\{0,\infty\}$, where $R=C[[t_1,\ldots,t_r]]/I$. The picture we offer shows that regular-singular connections are equivalent to representations of $\mathbb Z$, now over $R$.


title: Generative and reproducible benchmarks for comprehensive evaluation of machine learning classifiers

abstract: Understanding the strengths and weaknesses of machine learning (ML) algorithms is crucial for determine their scope of application. Here, we introduce the DIverse and GENerative ML Benchmark (DIGEN) - a collection of synthetic datasets for comprehensive, reproducible, and interpretable benchmarking of machine learning algorithms for classification of binary outcomes. The DIGEN resource consists of 40 mathematical functions which map continuous features to discrete endpoints for creating synthetic datasets. These 40 functions were discovered using a heuristic algorithm designed to maximize the diversity of performance among multiple popular machine learning algorithms thus providing a useful test suite for evaluating and comparing new methods. Access to the generative functions facilitates understanding of why a method performs poorly compared to other algorithms thus providing ideas for improvement. The resource with extensive documentation and analyses is open-source and available on GitHub.


title: Adaptability and the Pivot Penalty in Science

abstract: The ability to confront new questions, opportunities, and challenges is of fundamental importance to human progress and the resilience of human societies, yet the capacity of science to meet new demands remains poorly understood. Here we deploy a new measurement framework to investigate the scientific response to the COVID-19 pandemic and the adaptability of science as a whole. We find that science rapidly shifted to engage COVID-19 following the advent of the virus, with scientists across all fields making large jumps from their prior research streams. However, this adaptive response reveals a pervasive "pivot penalty", where the impact of the new research steeply declines the further the scientists move from their prior work. The pivot penalty is severe amidst COVID-19 research, but it is not unique to COVID-19. Rather it applies nearly universally across the sciences, and has been growing in magnitude over the past five decades. While further features condition pivoting, including a scientist's career stage, prior expertise and impact, collaborative scale, the use of new coauthors, and funding, we find that the pivot penalty persists and remains substantial regardless of these features, suggesting the pivot penalty acts as a fundamental friction that governs science's ability to adapt. The pivot penalty not only holds key implications for the design of the scientific system and human capacity to confront emergent challenges through scientific advance, but may also be relevant to other social and economic systems, where shifting to meet new demands is central to survival and success.


title: Determination of the $^{209}$Bi(n,$\gamma$)$^{210g}$Bi cross section using the NICE-Detector

abstract: The capture cross section of $^{209}$Bi(n,$\gamma$)$^{210g}$Bi was measured at different astrophysically energies including thermal capture cross section (25 meV), resonance integral, and the Maxwellian averaged cross section at a thermal energy of $kT$ = 30 keV. The partial capture cross section ($\sigma_g$) was determined using the activation technique and by measuring the $^{210}$Po activity. The newly developed and tested NICE detector setup was used to measure the $\alpha$-activity of the $^{210}$Po. Using this setup the thermal and resonance integral cross sections were determined to be $16.2\;\pm\;0.97$~mb and $89.81\;\pm\;8.0$~mb, respectively. And the Maxwellian average cross section was measured to be $2.01\;\pm\;0.38$~mb.


title: Evolution of the local spiral structure of the Milky Way revealed by open clusters

abstract: The structure and evolution of the spiral arms of our Milky Way are basic but long-standing questions in astronomy. In particular, the lifetime of spiral arms is still a puzzle and has not been well constrained from observations. In this work, we aim to inspect these issues using a large catalogue of open clusters. We compiled a catalogue of 3794 open clusters based on Gaia EDR3. A majority of these clusters have accurately determined parallaxes, proper motions, and radial velocities. The age parameters for these open clusters are collected from references or calculated in this work. In order to understand the nearby spiral structure and its evolution, we analysed the distributions, kinematic properties, vertical distributions, and regressed properties of subsamples of open clusters. We find evidence that the nearby spiral arms are compatible with a long-lived spiral pattern and might have remained approximately stable for the past 80 million years. In particular, the Local Arm, where our Sun is currently located, is also suggested to be long-lived in nature and probably a major arm segment of the Milky Way. The evolutionary characteristics of nearby spiral arms show that the dynamic spiral mechanism might be not prevalent for our Galaxy. Instead, density wave theory is more consistent with the observational properties of open clusters.


title: Global well-posedness for the 2D micropolar Rayleigh-B\'{e}nard convection problem

abstract: In this article, we study the Cauchy problem to the micropolar Rayleigh-B\'{e}nard convection problem without velocity dissipation in two dimension. We first prove the local well-posedness of a smooth solution, and then establish a blow up criterion in terms of the gradient of scalar temperature field. At last, we obtain the global well-posedness to the system.


title: Strands algebras and the affine highest weight property for equivariant hypertoric categories

abstract: We show that the equivariant hypertoric convolution algebras introduced by Braden-Licata-Proudfoot-Webster are affine quasi hereditary in the sense of Kleshchev and compute the Ext groups between standard modules. Together with the main result of arXiv:2009.03981, this implies a number of new homological results about the bordered Floer algebras of Ozsvath-Szabo, including the existence of standard modules over these algebras. We prove that the Ext groups between standard modules are isomorphic to the homology of a variant of the Lipshitz-Ozsvath-Thurston bordered strands dg algebras.


title: A Convolutional Neural Network Approach to the Classification of Engineering Models

abstract: This paper presents a deep learning approach for the classification of Engineering (CAD) models using Convolutional Neural Networks (CNNs). Owing to the availability of large annotated datasets and also enough computational power in the form of GPUs, many deep learning-based solutions for object classification have been proposed of late, especially in the domain of images and graphical models. Nevertheless, very few solutions have been proposed for the task of functional classification of CAD models. Hence, for this research, CAD models have been collected from Engineering Shape Benchmark (ESB), National Design Repository (NDR) and augmented with newer models created using a modelling software to form a dataset - 'CADNET'. It is proposed to use a residual network architecture for CADNET, inspired by the popular ResNet. A weighted Light Field Descriptor (LFD) scheme is chosen as the method of feature extraction, and the generated images are fed as inputs to the CNN. The problem of class imbalance in the dataset is addressed using a class weights approach. Experiments have been conducted with other signatures such as geodesic distance etc. using deep networks as well as other network architectures on the CADNET. The LFD-based CNN approach using the proposed network architecture, along with gradient boosting yielded the best classification accuracy on CADNET.


title: Real-time dynamics of the $O(4)$ scalar theory within the fRG approach

abstract: In this paper, the real-time dynamics of the $O(4)$ scalar theory is studied within the functional renormalization group formulated on the Schwinger-Keldysh closed time path. The flow equations for the effective action and its $n$-point correlation functions are derived in terms of the "classical" and "quantum" fields, and a concise diagrammatic representation is presented. An analytic expression for the flow of the four-point vertex is obtained. Spectral functions with different values of temperature and momentum are obtained. Moreover, we calculate the dynamical critical exponent for the phase transition near the critical temperature in the $O(4)$ scalar theory in $3+1$ dimensions, and the value is found to be $z\simeq 2.023$.


title: From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text

abstract: Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to generate Hindi-English code-switched sentences starting from monolingual Hindi sentences. We outline a carefully designed curriculum of pretraining steps, including the use of synthetic code-switched text, that enable the model to generate high-quality code-switched text. Using text generated from our model as data augmentation, we show significant reductions in perplexity on a language modeling task, compared to using text from other generative models of CS text. We also show improvements using our text for a downstream code-switched natural language inference task. Our generated text is further subjected to a rigorous evaluation using a human evaluation study and a range of objective metrics, where we show performance comparable (and sometimes even superior) to code-switched text obtained via crowd workers who are native Hindi speakers.