title: Fast mass lumped multiscale wave propagation modelling

abstract: In this paper, we investigate the use of a mass lumped fully explicit time stepping scheme for the discretisation of the wave equation with underlying material parameters that vary at arbitrarily fine scales. We combine the leapfrog scheme for the temporal discretisation with the multiscale technique known as Localized Orthogonal Decomposition for the spatial discretisation. To speed up the method and to make it fully explicit, a special mass lumping approach is introduced that relies on an appropriate interpolation operator. This operator is also employed in the construction of the Localized Orthogonal Decomposition and is a key feature of the approach. We prove that the method converges with second order in the energy norm, with a leading constant that does not depend on the scales at which the material parameters vary. We also illustrate the performance of the mass lumped method in a set of numerical experiments.


title: H_\infty Almost Output and Regulated Output Synchronization of Heterogeneous Multi-agent Systems: A Scale-free Protocol Design

abstract: This paper studies scale-free protocol design for H_\infty almost output and regulated output synchronization of heterogeneous multi-agent systems with linear, right-invertible, and introspective agents in presence of external disturbances. The collaborative linear protocol designs are based on localized information exchange over the same communication network, which do not require any knowledge of the directed network topology and spectrum of the associated Laplacian matrix. Moreover, the proposed scale-free protocols achieve H_\infty almost synchronization with a given arbitrary degree of accuracy for any size of the network.


title: An inherited complex organic molecule reservoir in a warm planet-hosting disk

abstract: Quantifying the composition of the material in protoplanetary disks is paramount to determining the potential for exoplanetary systems to produce and support habitable environments. A key complex organic molecule (COM) to detect is methanol (CH3OH). CH3OH primarily forms at low temperatures via the hydrogenation of CO ice on the surface of icy dust grains and is a necessary basis for the formation of more complex species like amino acids and proteins. We report the detection of CH3OH in a disk around a young, luminous A-type star HD100546. This disk is warm and therefore does not host a significant CO ice reservoir. We argue that the CH3OH cannot form in situ, and hence, this disk has likely inherited COMs rich ice from an earlier cold dark cloud phase. This is strong evidence that at least some of the organic material survives the disk formation process and can then be incorporated into forming planets, moons and comets. Therefore, crucial pre-biotic chemical evolution already takes place in dark star-forming clouds.


title: Linkage of Sets of Cyclic Algebras

abstract: Let $p$ be a prime integer and $F$ the function field in two algebraically independent variables over a smaller field $F_0$. We prove that if $\operatorname{char}(F_0)=p\geq 3$ then there exist $p^2-1$ cyclic algebras of degree $p$ over $F$ that have no maximal subfield in common, and if $\operatorname{char}(F_0)=0$ then there exist $p^2$ cyclic algebras of degree $p$ over $F$ that have no maximal subfield in common.


title: ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoning

abstract: Understanding how events are semantically related to each other is the essence of reading comprehension. Recent event-centric reading comprehension datasets focus mostly on event arguments or temporal relations. While these tasks partially evaluate machines' ability of narrative understanding, human-like reading comprehension requires the capability to process event-based information beyond arguments and temporal reasoning. For example, to understand causality between events, we need to infer motivation or purpose; to establish event hierarchy, we need to understand the composition of events. To facilitate these tasks, we introduce ESTER, a comprehensive machine reading comprehension (MRC) dataset for Event Semantic Relation Reasoning. The dataset leverages natural language queries to reason about the five most common event semantic relations, provides more than 6K questions and captures 10.1K event relation pairs. Experimental results show that the current SOTA systems achieve 22.1%, 63.3%, and 83.5% for token-based exact-match, F1, and event-based HIT@1 scores, which are all significantly below human performances (36.0%, 79.6%, 100% respectively), highlighting our dataset as a challenging benchmark.


title: Conformal bridge transformation and PT symmetry

abstract: The conformal bridge transformation (CBT) is reviewed in the light of the $\mathcal{PT}$ symmetry. Originally, the CBT was presented as a non-unitary transformation (a complex canonical transformation in the classical case) that relates two different forms of dynamics in the sense of Dirac. Namely, it maps the asymptotically free form into the harmonically confined form of dynamics associated with the $\mathfrak{so}(2,1)\cong \mathfrak{sl}(2,{\mathbb R})$ conformal symmetry. However, as the transformation relates the non-Hermitian operator $i\hat{D}$, where $\hat{D}$ is the generator of dilations, with the compact Hermitian generator $\hat{\mathcal{J}}_0$ of the $\mathfrak{sl}(2,{\mathbb R})$ algebra, the CBT generator can be associated with a $\mathcal{PT}$-symmetric metric. In this work we review the applications of this transformation for one- and two-dimensional systems, as well as for systems on a cosmic string background, and for a conformally extended charged particle in the field of Dirac monopole. We also compare and unify the CBT with the Darboux transformation. The latter is used to construct $\mathcal{PT}$-symmetric solutions of the equations of the KdV hierarchy with the properties of extreme waves. As a new result, by using a modified CBT we relate the one-dimensional $\mathcal{PT}$-regularized asymptotically free conformal mechanics model with the $\mathcal{PT}$-regularized version of the de Alfaro, Fubini and Furlan system.


title: Luminescence anomaly of dipolar valley excitons in homobilayer semiconductor moir\'e superlattices

abstract: In twisted homobilayer transition metal dichalcogenides, intra- and inter-layer valley excitons hybridize with the layer configurations spatially varying in the moir\'e. The ground state valley excitons are trapped at two high-symmetry points with opposite electric dipoles in a moir\'e supercell, forming a honeycomb superlattice of nearest-neighbor dipolar attraction. We find that the spatial texture of layer configuration results in a luminescence anomaly of the moir\'e trapped excitons, where a tiny displacement by interactions dramatically increases the brightness and changes polarization from circular to linear. At full filling, radiative recombination predominantly occurs at edges and vacancies of the exciton superlattice. The anomaly also manifests in the cascaded emission of small clusters, producing chains of polarization entangled photons. An interlayer bias can switch the superlattice into a single-orbital triangular lattice with repulsive interactions only, where the luminescence anomaly can be exploited to distinguish ordered states and domain boundaries at fractional filling.


title: I Only Have Eyes for You: The Impact of Masks On Convolutional-Based Facial Expression Recognition

abstract: The current COVID-19 pandemic has shown us that we are still facing unpredictable challenges in our society. The necessary constrain on social interactions affected heavily how we envision and prepare the future of social robots and artificial agents in general. Adapting current affective perception models towards constrained perception based on the hard separation between facial perception and affective understanding would help us to provide robust systems. In this paper, we perform an in-depth analysis of how recognizing affect from persons with masks differs from general facial expression perception. We evaluate how the recently proposed FaceChannel adapts towards recognizing facial expressions from persons with masks. In Our analysis, we evaluate different training and fine-tuning schemes to understand better the impact of masked facial expressions. We also perform specific feature-level visualization to demonstrate how the inherent capabilities of the FaceChannel to learn and combine facial features change when in a constrained social interaction scenario.


title: Modeling neutron and X-ray scattering by liquids

abstract: We review exact formalisms for describing the dynamics of liquids in terms of static parameters. We discuss how these formalisms are prone to suffer from imposing restrictions that appear to adhere to common sense but which are overly restrictive, resulting in a flawed description of the dynamics of liquids. We detail a fail-safe way for modeling the scattering data of liquids that is free from any unwarranted restriction and that models the scattering using the fewest possible number of free parameters. We also list some common habits in analyzing data and how these habits do not do justice to the accuracy of the results obtained in scattering experiments, and how these habits may stand in the way of rejecting some models used in describing the dynamics of liquids.


title: Hercule: Representing and Reasoning about Norms as a Foundation for Declarative Contracts over Blockchain

abstract: Current blockchain approaches for business contracts are based on smart contracts, namely, software programs placed on a blockchain that are automatically executed to realize a contract. However, smart contracts lack flexibility and interfere with the autonomy of the parties concerned. We propose Hercule, an approach for declaratively specifying blockchain applications in a manner that reflects business contracts. Hercule represents a contract via regulatory norms that capture the involved parties' expectations of one another. It computes the states of norms (hence, of contracts) from events in the blockchain. Hercule's novelty and significance lie in that it operationalizes declarative contracts over semistructured databases, the underlying representation for practical blockchain such as Hyperledger Fabric and Ethereum. Specifically, it exploits the map-reduce capabilities of such stores to compute norm states. We demonstrate that our implementation over Hyperledger Fabric can process thousands of events per second, sufficient for many applications.


title: Interlayer magnetophononic coupling in MnBi2Te4

abstract: The emergence of magnetism in quantum materials creates a platform to realize spin-based applications in spintronics, magnetic memory, and quantum information science. A key to unlocking new functionalities in these materials is the discovery of tunable coupling between spins and other microscopic degrees of freedom. We present evidence for interlayer magnetophononic coupling in the layered magnetic topological insulator MnBi2Te4. Employing magneto-Raman spectroscopy, we observe anomalies in phonon scattering intensities across magnetic field-driven phase transitions, despite the absence of discernible static structural changes. This behavior is a consequence of a magnetophononic wave-mixing process that allows for the excitation of zone-boundary phonons that are otherwise 'forbidden' by momentum conservation. Our microscopic model based on density functional theory calculations reveals that this phenomenon can be attributed to phonons modulating the interlayer exchange coupling. Moreover, signatures of magnetophononic coupling are also observed in the time domain through the ultrafast excitation and detection of coherent phonons across magnetic transitions. In light of the intimate connection between magnetism and topology in MnBi2Te4, the magnetophononic coupling represents an important step towards coherent on-demand manipulation of magnetic topological phases.


title: Optimal operation of microgrids with risk-constrained state of charge

abstract: In this paper we present a stochastic scenario-based model predictive control (MPC) approach for the operation of islanded microgrids with high share of renewable energy sources. We require that the stored energy remains within given bounds with a certain probability using risk-based constraints as convex approximations of chance constraints. We show that risk constraints can generally be cast as conic constraints and, unlike chance constraints, can control both the number and average magnitude of constraint violations. Lastly, we demonstrate the risk-constrained stochastic MPC in a numerical case study.


title: A study of cool core resiliency and entropy mixing in simulations of galaxy cluster mergers

abstract: We present results from a suite of binary merging cluster simulations. The hydrodynamical cluster simulations are performed employing a smoothed particle hydrodynamics (SPH) formulation in which gradient errors are strongly reduced by means of an integral approach. We consider adiabatic as well as radiative simulations, in which we include gas cooling, star formation and energy feedback from supernovae. We explore the effects of merging on the thermodynamic structure of the intracluster gas of the final merger remnant. In particular, we study how core entropy is generated during the merging and the stability properties of the initial cool-core profile against disruption. To this end, we consider a range of initial mass ratio and impact parameters. Final entropy profiles of our adiabatic merging simulations are in good accord with previous findings (ZuHone 2011), with cool-cores being disrupted for all of the initial merging setups. For equal-mass off-axis mergers, we find that a significant contribution to the final primary core entropy is due to hydrodynamic instabilities generated by rotational motions, which are induced by tidal torques during the first pericenter passage. In radiative simulations, cool-cores are more resilient against heating processes; nonetheless, they are able to maintain their integrity only in the case of off-axis mergers with very unequal masses. We suggest that these results are robust against changes in the gas physical modeling, in particular to the inclusion of AGN thermal feedback. Our findings support the view that the observed core cluster morphology emerges naturally in a merging cluster context, and conclude that the merging angular momentum is a key parameter in shaping the thermodynamical properties of the final merger remnant.


title: In Defense of the Paper

abstract: The machine learning publication process is broken, of that there can be no doubt. Many of these flaws are attributed to the current workflow: LaTeX to PDF to reviewers to camera ready PDF. This has understandably resulted in the desire for new forms of publications; ones that can increase inclusively, accessibility and pedagogical strength. However, this venture fails to address the origins of these inadequacies in the contemporary paper workflow. The paper, being the basic unit of academic research, is merely how problems in the publication and research ecosystem manifest; but is not itself responsible for them. Not only will simply replacing or augmenting papers with different formats not fix existing problems; when used as a band-aid without systemic changes, will likely exacerbate the existing inequities. In this work, we argue that the root cause of hindrances in the accessibility of machine learning research lies not in the paper workflow but within the misaligned incentives behind the publishing and research processes. We discuss these problems and argue that the paper is the optimal workflow. We also highlight some potential solutions for the incentivization problems.


title: Composition of Terrestrial Exoplanet Atmospheres from Meteorite Outgassing Experiments

abstract: Terrestrial exoplanets likely form initial atmospheres through outgassing during and after accretion, although there is currently no first-principles understanding of how to connect a planet's bulk composition to its early atmospheric properties. Important insights into this connection can be gained by assaying meteorites, representative samples of planetary building blocks. We perform laboratory outgassing experiments that use a mass spectrometer to measure the abundances of volatiles released when meteorite samples are heated to 1200 $^{\circ}$C. We find that outgassing from three carbonaceous chondrite samples consistently produce H$_2$O-rich (averaged ~66 %) atmospheres but with significant amounts of CO (~18 %) and CO$_2$ (~15 %) as well as smaller quantities of H$_2$ and H$_2$S (up to 1 %). These results provide experimental constraints on the initial chemical composition in theoretical models of terrestrial planet atmospheres, supplying abundances for principal gas species as a function of temperature.


title: A Multiple Regression-Enhanced Convolution Estimator for the Density of a Response Variable in the Presence of Additional Covariate Information

abstract: In this paper we propose a convolution estimator for estimating the density of a response variable that employs an underlying multiple regression framework to enhance the accuracy of density estimates through the incorporation of auxiliary information. Suppose we have a sample consisting of $N$ complete case observations of a response variable and an associated set of covariates, along with an additional sample consisting of $M$ observations of the covariates only. We show that the mean square error of the multiple regression-enhanced convolution estimator converges as $O(N^{-1})$ towards zero, and moreover, for a large fixed $N$, that the mean square error converges as $O(M^{-4/5})$ towards an $O(N^{-1})$ constant. This is the first time that the convergence of a convolution estimator with respect to the amount of additional covariate information has been established. In contrast to convolution estimators based on the Nadaraya-Watson estimator for a nonlinear regression model, the multiple regression-enhanced convolution estimator proposed in this paper does not suffer from the curse of dimensionality. It is particularly useful for scenarios in which one wants to estimate the density of a response variable that is challenging to measure, while being in possession of a large amount of additional covariate information. In fact, an application of this type from the field of ophthalmology motivated our work in this paper.


title: Multiplicative preprojective algebras of Dynkin quivers

abstract: For a commutative ring $R$ and an ADE Dynkin quiver $Q$, we prove that the multiplicative preprojective algebra of Crawley-Boevey and Shaw, with parameter $q=1$, is isomorphic to the (additive) preprojective algebra as $R$-algebras if and only if the bad primes for $Q$ (2 in type D, 2 and 3 for $Q = E_{6}$, $E_{7}$ and 2, 3 and 5 for $Q= E_{8}$) are invertible in $R$. We construct an explicit isomorphism over $\mathbb{Z}[1/2]$ in type D, over $\mathbb{Z}[1/2, 1/3]$ for $Q = E_{6}$, $E_{7}$ and over $\mathbb{Z}[1/2, 1/3, 1/5]$ for $Q=E_{8}$. Conversely, if some bad prime is not invertible in $R$, we show that the additive and multiplicative preprojective algebras differ in zeroth Hochschild homology, and hence are not isomorphic. In fact, one only needs the vanishing of certain classes in zeroth Hochschild homology of the multiplicative preprojective algebra, utilizing a rigidification argument for isomorphisms that may be of independent interest. In the setting of Ginzburg dg-algebras, our obstructions are new in type E and give a more elementary proof of the negative result of Etg\"{u}--Lekili arXiv:1502.07922 in type D. Moreover, the zeroth Hochschild homology of the multiplicative preprojective algebra can be interpreted as the space of unobstructed deformations of the multiplicative Ginzburg dg-algebra by Van den Bergh duality. Finally, we observe that the multiplicative preprojective algebra is not symmetric Frobenius if $Q \neq A_1$, a departure from the additive preprojective algebra in characteristic 2 for $Q = D_{2n}$, $n \geq 2$ and $Q =E_{7}$, $E_{8}$.


title: StylePeople: A Generative Model of Fullbody Human Avatars

abstract: We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually poses a problem for mesh-based approaches. We also show how these avatars can be created from multiple frames of a video using backpropagation. We then propose a generative model for such avatars that can be trained from datasets of images and videos of people. The generative model allows us to sample random avatars as well as to create dressed avatars of people from one or few images. The code for the project is available at saic-violet.github.io/style-people.


title: Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning

abstract: Stochastic Gradient Descent (SGD) has become the de facto way to train deep neural networks in distributed clusters. A critical factor in determining the training throughput and model accuracy is the choice of the parameter synchronization protocol. For example, while Bulk Synchronous Parallel (BSP) often achieves better converged accuracy, the corresponding training throughput can be negatively impacted by stragglers. In contrast, Asynchronous Parallel (ASP) can have higher throughput, but its convergence and accuracy can be impacted by stale gradients. To improve the performance of synchronization protocol, recent work often focuses on designing new protocols with a heavy reliance on hard-to-tune hyper-parameters. In this paper, we design a hybrid synchronization approach that exploits the benefits of both BSP and ASP, i.e., reducing training time while simultaneously maintaining the converged accuracy. Based on extensive empirical profiling, we devise a collection of adaptive policies that determine how and when to switch between synchronization protocols. Our policies include both offline ones that target recurring jobs and online ones for handling transient stragglers. We implement the proposed policies in a prototype system, called Sync-Switch, on top of TensorFlow, and evaluate the training performance with popular deep learning models and datasets. Our experiments show that Sync-Switch achieves up to 5.13X throughput speedup and similar converged accuracy when comparing to BSP. Further, we observe that Sync-Switch achieves 3.8% higher converged accuracy with just 1.23X the training time compared to training with ASP. Moreover, Sync-Switch can be used in settings when training with ASP leads to divergence errors. Sync-Switch achieves all of these benefits with very low overhead, e.g., the framework overhead can be as low as 1.7% of the total training time.


title: Dobrushin and Steif metrics are equal

abstract: It is proved that two useful and apparently different metrics on the set of Borel probabilities on countable products of Polish spaces of bounded diameters are equal. This paves the way for advances in their computation.


title: A Gradual Type System for Elixir

abstract: Elixir is a functional programming language with dynamic typing. We propose a gradual type system that makes it possible to perform type-checking on a significant fragment of the language. An important feature of the type system is that it does not require any syntactic change to Elixir. Type information is provided by means of function signatures which are declared in terms of Elixir typespec directives. The proposed type system is based on subtyping and is backward compatible, as it allows the presence of untyped code fragments. We have implemented a prototype of the type-checker in Elixir itself.


title: Namikawa-Weyl groups of affinizations of smooth Nakajima quiver varieties

abstract: We give a description of the Namikawa-Weyl group of affinizations of smooth Nakajima quiver varieties using combinatorial data of the underlying quiver, and compute some explicit examples. This extends a result of McGerty and Nevins for quiver varieties coming from Dynkin quivers.


title: Motion Prediction Performance Analysis for Autonomous Driving Systems and the Effects of Tracking Noise

abstract: Autonomous driving consists of a multitude of interacting modules, where each module must contend with errors from the others. Typically, the motion prediction module depends upon a robust tracking system to capture each agent's past movement. In this work, we systematically explore the importance of the tracking module for the motion prediction task and ultimately conclude that the overall motion prediction performance is highly sensitive to the tracking module's imperfections. We explicitly compare models that use tracking information to models that do not across multiple scenarios and conditions. We find that the tracking information plays an essential role and improves motion prediction performance in noise-free conditions. However, in the presence of tracking noise, it can potentially affect the overall performance if not studied thoroughly. We thus argue practitioners should be mindful of noise when developing and testing motion/tracking modules, or that they should consider tracking free alternatives.


title: Combined analysis of HPK 3.1 LGADs using a proton beam, beta source, and probe station towards establishing high volume quality control

abstract: The upgrades of the CMS and ATLAS experiments for the high luminosity phase of the Large Hadron Collider will employ precision timing detectors based on Low Gain Avalanche Detectors (LGADs). We present a suite of results combining measurements from the Fermilab Test Beam Facility, a beta source telescope, and a probe station, allowing full characterization of the HPK type 3.1 production of LGAD prototypes developed for these detectors. We demonstrate that the LGAD response to high energy test beam particles is accurately reproduced with a beta source. We further establish that probe station measurements of the gain implant accurately predict the particle response and operating parameters of each sensor, and conclude that the uniformity of the gain implant in this production is sufficient to produce full-sized sensors for the ATLAS and CMS timing detectors.


title: Composing Effective Prediction at Five Points

abstract: Color-kinematics duality in the adjoint has proven key to the relationship between gauge and gravity theory scattering amplitude predictions. In recent work, we demonstrated that at four-point tree-level, a small number of color-dual EFT building blocks could encode all higher-derivative single-trace massless corrections to gauge and gravity theories compatible with adjoint double-copy. One critical aspect was the trivialization of building higher-derivative color-weights -- indeed, it is the mixing of kinematics with non-adjoint-type color-weights (like the permutation-invariant d^4) which permits description via adjoint double-copy. Here we find that such ideas clarify the predictions of local five-point higher-dimensional operators as well. We demonstrate how a single scalar building block can be combined with color structures to build higher-derivative color factors that generate, through double copy, the predictions of higher-derivative gauge-theory operators. These may then be suitably mapped, through another double-copy, to higher-derivative corrections in gravity.


title: Measurement of the energy dependence of the $e^+e^-\to B\bar{B}$, $B\bar{B}^*$ and $B^*\bar{B}^*$ exclusive cross sections

abstract: We report the first measurement of the exclusive cross sections $e^+e^-\to B\bar{B}$, $e^+e^-\to B\bar{B}^*$, and $e^+e^-\to B^*\bar{B}^*$ in the energy range from 10.63 GeV to 11.02 GeV. The $B$ mesons are fully reconstructed in a large number of hadronic final states and the three channels are identified using a beam-constrained-mass variable. The shapes of the exclusive cross sections show oscillatory behavior with several maxima and minima. The results are obtained using data collected by the Belle experiment at the KEKB asymmetric-energy $e^+e^-$ collider.


title: Real-time reconstruction of intense, ultrafast laser pulses using deep learning

abstract: Ultrafast lasers ($< 500$ fs) have enabled laser-matter interactions at intensities exceeding $10^{18} \rm{Wcm}^{-2}$ with only millijoules of laser energy. However, as pulse durations become shorter, larger spectral bandwidths are required. Increasing the bandwidth causes the temporal structure to be increasingly sensitive to spectral phase, yet measuring the spectral phase of a laser pulse is nontrivial. While direct measurements of the spectral phase cannot be done using square-integrable detectors, phase information can be reconstructed by measuring the spectral response of a nonlinear optical effect. We introduce a new deep learning approach using the generalized nonlinear Schr\"{o}dinger equation and self-phase modulation, a $\chi_3$ nonlinearity occurring from material propagation. By training a neural network on numerical simulations of pulses propagating in a known material, the features of spectral change can be use to reconstruct the spectral phase. The technique is also sensitive to the local fluence of the pulse, enabling the full temporal intensity profile to be calculated. We demonstrate our method on a simulated large bandwidth pulse undergoing moderate material dispersion, and an experimentally produced broadband spectrum with substantial material dispersion. Error rates are low, even when modest amounts of noise introduced. With a single plate of glass and an optical spectrometer, single shot phase and fluence measurements are possible in real-time on intense ultrafast laser systems.


title: Constructing Robust Emotional State-based Feature with a Novel Voting Scheme for Multi-modal Deception Detection in Videos

abstract: Deception detection is an important task that has been a hot research topic due to its potential applications. It can be applied in many areas, from national security (e.g., airport security, jurisprudence, and law enforcement) to real-life applications (e.g., business and computer vision). However, some critical problems still exist and are worth more investigation. One of the significant challenges in the deception detection tasks is the data scarcity problem. Until now, only one multi-modal benchmark open dataset for human deception detection has been released, which contains 121 video clips for deception detection (i.e., 61 for deceptive class and 60 for truthful class). Such an amount of data is hard to drive deep neural network-based methods. Hence, those existing models often suffer from overfitting problems and low generalization ability. Moreover, the ground truth data contains some unusable frames for many factors. However, most of the literature did not pay attention to these problems. Therefore, in this paper, we design a series of data preprocessing methods to deal with the aforementioned problem first. Then, we propose a multi-modal deception detection framework to construct our novel emotional state-based feature and use the open toolkit openSMILE to extract the features from the audio modality. We also design a voting scheme to combine the emotional states information obtained from visual and audio modalities. Finally, we can determine the novel emotion state transformation feature with our self-designed algorithms. In the experiment, we conduct the critical analysis and comparison of the proposed methods with the state-of-the-art multi-modal deception detection methods. The experimental results show that the overall performance of multi-modal deception detection has a significant improvement in the accuracy from 87.77% to 92.78% and the ROC-AUC from 0.9221 to 0.9265.


title: Data-driven Chaos Indicator for Nonlinear Dynamics and Applications on Storage Ring Lattice Design

abstract: A data-driven chaos indicator concept is introduced to characterize the degree of chaos for nonlinear dynamical systems. The indicator is represented by the prediction accuracy of surrogate models established purely from data. It provides a metric for the predictability of nonlinear motions in a given system. When using the indicator to implement a tune-scan for a quadratic Henon map, the main resonances and their asymmetric stop-band widths can be identified. When applied to particle transportation in a storage ring, as particle motion becomes more chaotic, its surrogate model prediction accuracy decreases correspondingly. Therefore, the prediction accuracy, acting as a chaos indicator, can be used directly as the objective for nonlinear beam dynamics optimization. This method provides a different perspective on nonlinear beam dynamics and an efficient method for nonlinear lattice optimization. Applications in dynamic aperture optimization are demonstrated as real world examples.


title: CMB anisotropies generated by cosmic string loops

abstract: We investigate the contribution of cosmic string loops to the Cosmic Microwave Background (CMB) anisotropies. This is done by extending the Unconnected Segment Model (USM) to include the contribution of the cosmic string loops created throughout the cosmological evolution of a cosmic string network to the stress-energy tensor. We then implement this extended USM in the publicly available CMBACT code and obtain the linear CDM power spectrum and the CMB angular power spectra generated by cosmic string loops. We find that the shape of the angular power spectra generated by loops is, in general, similar to that of long strings. However, there is generally an enhancement of the anisotropies on small angular scales. Vector modes produced by loops dominate over those produced by long strings for large multipole moments $\ell$. The contribution of loops to the CMB anisotropies generated by cosmic string networks may reach a level of $10\%$ for large loops but decreases as the size of loops decreases. This contribution may then be significant and, thus, this extension provides a more accurate prediction of the CMB anisotropies generated by cosmic string networks.


title: Concadia: Towards Image-Based Text Generation with a Purpose

abstract: Current deep learning models often achieve excellent results on benchmark image-to-text datasets but fail to generate texts that are useful in practice. We argue that to close this gap, it is vital to distinguish descriptions from captions based on their distinct communicative roles. Descriptions focus on visual features and are meant to replace an image (often to increase accessibility), whereas captions appear alongside an image to supply additional information. To motivate this distinction and help people put it into practice, we introduce the publicly available Wikipedia-based dataset Concadia consisting of 96,918 images with corresponding English-language descriptions, captions, and surrounding context. Using insights from Concadia, models trained on it, and a preregistered human-subjects experiment with human- and model-generated texts, we characterize the commonalities and differences between descriptions and captions. In addition, we show that, for generating both descriptions and captions, it is useful to augment image-to-text models with representations of the textual context in which the image appeared.


title: Barnich-Troessaert Bracket as a Dirac Bracket on the Covariant Phase Space

abstract: The Barnich--Troessaert bracket is a proposal for a modified Poisson bracket on the covariant phase space for general relativity. The new bracket allows us to compute charges, which are otherwise not integrable. Yet there is a catch. There is a clear prescription for how to evaluate the new bracket for any such charge, but little is known how to extend the bracket to the entire phase space. This is a problem, because not every gravitational observable is also a charge. In this paper, we propose such an extension. The basic idea is to remove the radiative data from the covariant phase space. This requires second-class constraints. Given a few basic assumptions, we show that the resulting Dirac bracket on the constraint surface is nothing but the BT bracket. A heuristic argument is given to show that the resulting constraint surface can only contain gravitational edge modes.


title: Accelerating Sparse Deep Neural Networks

abstract: As neural network model sizes have dramatically increased, so has the interest in various techniques to reduce their parameter counts and accelerate their execution. An active area of research in this field is sparsity - encouraging zero values in parameters that can then be discarded from storage or computations. While most research focuses on high levels of sparsity, there are challenges in universally maintaining model accuracy as well as achieving significant speedups over modern matrix-math hardware. To make sparsity adoption practical, the NVIDIA Ampere GPU architecture introduces sparsity support in its matrix-math units, Tensor Cores. We present the design and behavior of Sparse Tensor Cores, which exploit a 2:4 (50%) sparsity pattern that leads to twice the math throughput of dense matrix units. We also describe a simple workflow for training networks that both satisfy 2:4 sparsity pattern requirements and maintain accuracy, verifying it on a wide range of common tasks and model architectures. This workflow makes it easy to prepare accurate models for efficient deployment on Sparse Tensor Cores.


title: A dusty filament and turbulent CO spirals in HD135344B-SAO206462

abstract: Planet-disc interactions build up local pressure maxima that may halt the radial drift of protoplanetary dust, and pile it up in rings and crescents. ALMA observations of the HD135344B disc revealed two rings in the thermal continuum stemming from ~mm-sized dust. At higher frequencies the inner ring is brighter relative to the outer ring, which is also shaped as a crescent rather than a full ring. In near-IR scattered light images, the disc is modulated by a 2-armed grand-design spiral originating inside the ALMA inner ring. Such structures may be induced by a massive companion evacuating the central cavity, and by a giant planet in the gap separating both rings, that channels the accretion of small dust and gas through its filamentary wakes while stopping the larger dust from crossing the gap. Here we present ALMA observations in the J=(2-1)CO isotopologue lines and in the adjacent continuum, with up to 12km baselines. Angular resolutions of 0.03" reveal the tentative detection of a filament connecting both rings, and which coincides with a local discontinuity in the pitch angle of the IR spiral, proposed previously as the location of the protoplanet driving this spiral. Line diagnostics suggest that turbulence, or superposed velocity components, is particularly strong in the spirals. The 12CO(2-1) 3-D rotation curve points at stellocentric accretion at radii within the inner dust ring, with a radial velocity of up to ~6%+-0.5% Keplerian, which corresponds to an excessively large accretion rate of ~2E-6M_sun/yr if all of the CO layer follows the 12CO(2-1) kinematics. This suggests that only the surface layers of the disc are undergoing accretion, and that the line broadening is due to superposed laminar flows.


title: Biofilm self-patterning: mechanical forces drive a reorientation cascade

abstract: In growing active matter systems, a large collection of engineered or living autonomous units metabolize free energy and create order at different length scales as they proliferate and migrate collectively. One such example is bacterial biofilms, which are surface-attached aggregates of bacterial cells embedded in an extracellular matrix. However, how bacterial growth coordinates with cell-surface interactions to create distinctive, long-range order in biofilms remains elusive. Here we report a collective cell reorientation cascade in growing Vibrio cholerae biofilms, leading to a differentially ordered, spatiotemporally coupled core-rim structure reminiscent of a blooming aster. Cell verticalization in the core generates differential growth that drives radial alignment of the cells in the rim, while the radially aligned rim in turn generates compressive stresses that expand the verticalized core. Such self-patterning disappears in adhesion-less mutants but can be restored through opto-manipulation of growth. Agent-based simulations and two-phase active nematic modeling reveal the strong interdependence of the driving forces for the differential ordering. Our findings provide insight into the collective cell patterning in bacterial communities and engineering of phenotypes and functions of living active matter.


title: Robust Object Detection via Instance-Level Temporal Cycle Confusion

abstract: Building reliable object detectors that are robust to domain shifts, such as various changes in context, viewpoint, and object appearances, is critical for real-world applications. In this work, we study the effectiveness of auxiliary self-supervised tasks to improve the out-of-distribution generalization of object detectors. Inspired by the principle of maximum entropy, we introduce a novel self-supervised task, instance-level temporal cycle confusion (CycConf), which operates on the region features of the object detectors. For each object, the task is to find the most different object proposals in the adjacent frame in a video and then cycle back to itself for self-supervision. CycConf encourages the object detector to explore invariant structures across instances under various motions, which leads to improved model robustness in unseen domains at test time. We observe consistent out-of-domain performance improvements when training object detectors in tandem with self-supervised tasks on large-scale video datasets (BDD100K and Waymo open data). The joint training framework also establishes a new state-of-the-art on standard unsupervised domain adaptative detection benchmarks (Cityscapes, Foggy Cityscapes, and Sim10K). The code and models are available at https://github.com/xinw1012/cycle-confusion.


title: Lower Bounds on Cross-Entropy Loss in the Presence of Test-time Adversaries

abstract: Understanding the fundamental limits of robust supervised learning has emerged as a problem of immense interest, from both practical and theoretical standpoints. In particular, it is critical to determine classifier-agnostic bounds on the training loss to establish when learning is possible. In this paper, we determine optimal lower bounds on the cross-entropy loss in the presence of test-time adversaries, along with the corresponding optimal classification outputs. Our formulation of the bound as a solution to an optimization problem is general enough to encompass any loss function depending on soft classifier outputs. We also propose and provide a proof of correctness for a bespoke algorithm to compute this lower bound efficiently, allowing us to determine lower bounds for multiple practical datasets of interest. We use our lower bounds as a diagnostic tool to determine the effectiveness of current robust training methods and find a gap from optimality at larger budgets. Finally, we investigate the possibility of using of optimal classification outputs as soft labels to empirically improve robust training.


title: Optimal Pose and Shape Estimation for Category-level 3D Object Perception

abstract: We consider a category-level perception problem, where one is given 3D sensor data picturing an object of a given category (e.g. a car), and has to reconstruct the pose and shape of the object despite intra-class variability (i.e. different car models have different shapes). We consider an active shape model, where -- for an object category -- we are given a library of potential CAD models describing objects in that category, and we adopt a standard formulation where pose and shape estimation are formulated as a non-convex optimization. Our first contribution is to provide the first certifiably optimal solver for pose and shape estimation. In particular, we show that rotation estimation can be decoupled from the estimation of the object translation and shape, and we demonstrate that (i) the optimal object rotation can be computed via a tight (small-size) semidefinite relaxation, and (ii) the translation and shape parameters can be computed in closed-form given the rotation. Our second contribution is to add an outlier rejection layer to our solver, hence making it robust to a large number of misdetections. Towards this goal, we wrap our optimal solver in a robust estimation scheme based on graduated non-convexity. To further enhance robustness to outliers, we also develop the first graph-theoretic formulation to prune outliers in category-level perception, which removes outliers via convex hull and maximum clique computations; the resulting approach is robust to 70%-90% outliers. Our third contribution is an extensive experimental evaluation. Besides providing an ablation study on a simulated dataset and on the PASCAL3D+ dataset, we combine our solver with a deep-learned keypoint detector, and show that the resulting approach improves over the state of the art in vehicle pose estimation in the ApolloScape datasets.


title: "Wikily" Supervised Neural Translation Tailored to Cross-Lingual Tasks

abstract: We present a simple but effective approach for leveraging Wikipedia for neural machine translation as well as cross-lingual tasks of image captioning and dependency parsing without using any direct supervision from external parallel data or supervised models in the target language. We show that first sentences and titles of linked Wikipedia pages, as well as cross-lingual image captions, are strong signals for a seed parallel data to extract bilingual dictionaries and cross-lingual word embeddings for mining parallel text from Wikipedia. Our final model achieves high BLEU scores that are close to or sometimes higher than strong supervised baselines in low-resource languages; e.g. supervised BLEU of 4.0 versus 12.1 from our model in English-to-Kazakh. Moreover, we tailor our wikily supervised translation models to unsupervised image captioning, and cross-lingual dependency parser transfer. In image captioning, we train a multi-tasking machine translation and image captioning pipeline for Arabic and English from which the Arabic training data is a translated version of the English captioning data, using our wikily-supervised translation models. Our captioning results on Arabic are slightly better than that of its supervised model. In dependency parsing, we translate a large amount of monolingual text, and use it as artificial training data in an annotation projection framework. We show that our model outperforms recent work on cross-lingual transfer of dependency parsers.


title: Non-convex geometry of numbers and continued fractions

abstract: In recent work, the first two authors constructed a generalized continued fraction called the $p$-continued fraction, characterized by the property that its convergents (a subsequence of the regular convergents) are best approximations with respect to the $L^p$ norm, where $p\geq 1$. We extend this construction to the region $0<p<1$, where now the $L^p$ quasinorm is non-convex. We prove that the approximation coefficients of the $p$-continued fraction are bounded above by $1/\sqrt{5}+\varepsilon_p$, where $\varepsilon_p\to 0$ as $p\to 0$. In light of Hurwitz's theorem, this upper bound is sharp, in the limit. We also measure the maximum number of consecutive regular convergents that are skipped by the $p$-continued fraction.


title: Inverse Boundary Value Problems for Wave Equations with Quadratic Nonlinearities

abstract: We study inverse problems for the nonlinear wave equation $\square_g u + w(x,u, \nabla_g u) = 0$ in a Lorentzian manifold $(M,g)$ with boundary, where $\nabla_g u$ denotes the gradient and $w(x,u, \xi)$ is smooth and quadratic in $\xi$. Under appropriate assumptions, we show that the conformal class of the Lorentzian metric $g$ can be recovered up to diffeomorphisms, from the knowledge of the Neumann-to-Dirichlet map. With some additional conditions, we can recover the metric itself up to diffeomorphisms. Moreover, we can recover the second and third quadratic forms in the Taylor expansion of $w(x,u, \xi)$ with respect to $u$ up to null forms.


title: Stack of $S_{3}$-covers

abstract: The aim of this paper is to study the geometry of the stack of $S_{3}$-covers. We show that it has two irreducible components $\mathcal{Z}_{S_{3}}$ and $\mathcal{Z}_{2}$ meeting in a "degenerate" point $\{0\}$, $\mathcal{Z}_{2}-\{0\}\simeq \rm B\rm{GL}_{2}$, while $(\mathcal{Z}_{S_{3}}-\{0\})$, which contains $\rm B S_{3}$ as open substack, is a smooth and universally closed algebraic stack. More precisely we show that $\mathcal{Z}_{S_{3}}-\{0\}\simeq[X/\rm{GL}_{2}]$, where $X$ is an explicit smooth non degenerate projective surface inside $\mathbb{P}^{7}$ intersection of five quadrics. All these results are based on the description of certain families of $S_{3}$-covers in terms of "building data".


title: Neural String Edit Distance

abstract: We propose the neural string edit distance model for string-pair matching and string transduction based on learnable string edit distance. We modify the original expectation-maximization learned edit distance algorithm into a differentiable loss function, allowing us to integrate it into a neural network providing a contextual representation of the input. We evaluate on cognate detection, transliteration, and grapheme-to-phoneme conversion, and show that we can trade off between performance and interpretability in a single framework. Using contextual representations, which are difficult to interpret, we match the performance of state-of-the-art string-pair matching models. Using static embeddings and a slightly different loss function, we force interpretability, at the expense of an accuracy drop.


title: Rankings in directed configuration models with heavy tailed in-degrees

abstract: We consider the extremal values of the stationary distribution of sparse directed random graphs with given degree sequences and their relation to the extremal values of the in-degree sequence. The graphs are generated by the directed configuration model. Under the assumption of bounded $(2+\eta)$-moments on the in-degrees and of bounded out-degrees, we obtain tight comparisons between the maximum value of the stationary distribution and the maximum in-degree. Under the further assumption that the order statistics of the in-degrees have a power-law behavior, we show that the extremal values of the stationary distribution also have a power-law behavior with the same index. In the same setting, we prove that these results extend to the PageRank scores of the random digraph, thus confirming a version of the so-called power-law hypothesis. Along the way, we establish several facts about the model, including the mixing time cutoff and the characterization of the typical values of the stationary distribution, which were previously obtained under the assumption of bounded in-degrees.


title: Universal Background Subtraction based on Arithmetic Distribution Neural Network

abstract: We propose a universal background subtraction framework based on the Arithmetic Distribution Neural Network (ADNN) for learning the distributions of temporal pixels. In our ADNN model, the arithmetic distribution operations are utilized to introduce the arithmetic distribution layers, including the product distribution layer and the sum distribution layer. Furthermore, in order to improve the accuracy of the proposed approach, an improved Bayesian refinement model based on neighboring information, with a GPU implementation, is incorporated. In the forward pass and backpropagation of the proposed arithmetic distribution layers, histograms are considered as probability density functions rather than matrices. Thus, the proposed approach is able to utilize the probability information of the histogram and achieve promising results with a very simple architecture compared to traditional convolutional neural networks. Evaluations using standard benchmarks demonstrate the superiority of the proposed approach compared to state-of-the-art traditional and deep learning methods. To the best of our knowledge, this is the first method to propose network layers based on arithmetic distribution operations for learning distributions during background subtraction.


title: Learning To Count Everything

abstract: Existing works on visual counting primarily focus on one specific category at a time, such as people, animals, and cells. In this paper, we are interested in counting everything, that is to count objects from any category given only a few annotated instances from that category. To this end, we pose counting as a few-shot regression task. To tackle this task, we present a novel method that takes a query image together with a few exemplar objects from the query image and predicts a density map for the presence of all objects of interest in the query image. We also present a novel adaptation strategy to adapt our network to any novel visual category at test time, using only a few exemplar objects from the novel category. We also introduce a dataset of 147 object categories containing over 6000 images that are suitable for the few-shot counting task. The images are annotated with two types of annotation, dots and bounding boxes, and they can be used for developing few-shot counting models. Experiments on this dataset shows that our method outperforms several state-of-the-art object detectors and few-shot counting approaches. Our code and dataset can be found at https://github.com/cvlab-stonybrook/LearningToCountEverything.


title: Unsupervised Extractive Summarization by Human Memory Simulation

abstract: Summarization systems face the core challenge of identifying and selecting important information. In this paper, we tackle the problem of content selection in unsupervised extractive summarization of long, structured documents. We introduce a wide range of heuristics that leverage cognitive representations of content units and how these are retained or forgotten in human memory. We find that properties of these representations of human memory can be exploited to capture relevance of content units in scientific articles. Experiments show that our proposed heuristics are effective at leveraging cognitive structures and the organization of the document (i.e.\ sections of an article), and automatic and human evaluations provide strong evidence that these heuristics extract more summary-worthy content units.


title: Solar wind rotation rate and shear at coronal hole boundaries, possible consequences for magnetic field inversions

abstract: In-situ measurements by several spacecraft have revealed that the solar wind is frequently perturbed by transient structures (magnetic folds, jets, waves, flux-ropes) that propagate rapidly away from the Sun over large distances. Parker Solar Probe has detected frequent rotations of the magnetic field vector at small heliocentric distances, accompanied by surprisingly large solar wind rotation rates. The physical origin of such magnetic field bends, the conditions for their survival across the interplanetary space, and their relation to solar wind rotation are yet to be clearly understood. We traced measured solar wind flows from the spacecraft position down to the surface of the Sun to identify their potential source regions and used a global MHD model of the corona and solar wind to relate them to the rotational state of the low solar corona. We identified regions of the solar corona for which solar wind speed and rotational shear are important and long-lived, that can be favourable to the development of magnetic deflections and to their propagation across extended heights in the solar wind. We show that coronal rotation is highly structured and that enhanced flow shear develops near the boundaries between coronal holes and streamers, around and above pseudo-streamers, even when such boundaries are aligned with the direction of solar rotation. A large fraction of the switchbacks identified by PSP map back to these regions, both in terms of instantaneous magnetic field connectivity and of the trajectories of wind streams that reach the spacecraft. These regions of strong shears are likely to leave an imprint on the solar wind over large distances and to increase the transverse speed variability in the slow solar wind. The simulations and connectivity analysis suggest they can be a source of the switchbacks and spikes observed by Parker Solar Probe.


title: New families in our Solar neighborhood: applying Gaussian Mixture models for objective classification of structures in the Milky Way and in simulations

abstract: The standard picture of galaxy formation motivates the decomposition of the Milky Way into 3--4 stellar populations with distinct kinematic and elemental abundance distributions: the thin disk, thick disk, bulge, and stellar halo. To test this idea, we construct a Gaussian mixture model (GMM) for both simulated and observed stars in the Solar neighborhood, using measured velocities and iron abundances (i.e., an augmented Toomre diagram) as the distributions to be decomposed. We compare results for the Gaia-APOGEE DR16 crossmatch catalog of the Solar neighborhood with those from a suite of synthetic Gaia-APOGEE crossmatches constructed from FIRE-2 cosmological simulations of Milky Way-mass galaxies. We find that in both the synthetic and real data, the best-fit GMM uses five independent components, some of whose properties resemble the standard populations predicted by galaxy formation theory. Two components can be identified unambiguously as the thin disk and another as the halo. However, instead of a single counterpart to the thick disk, there are three intermediate components with different age and alpha abundance distributions (although these data are not used to construct the model). We use decompositions of the synthetic data to show that the classified components indeed correspond to stars with different origins. By analogy with the simulated data, we show that our mixture model of the real Gaia-APOGEE crossmatch distinguishes the following components: (1) a classic thin disk of young stars on circular orbits (46%), (2) thin disk stars heated by interactions with satellites (22%), (3, 4) two components representing the velocity asymmetry of the alpha-enhanced thick disk (27%), and (5) a stellar halo consistent with early, massive accretion (4%).


title: Manifold Model for High-Resolution fMRI Joint Reconstruction and Dynamic Quantification

abstract: Oscillating Steady-State Imaging (OSSI) is a recent fMRI acquisition method that exploits a large and oscillating signal, and can provide high SNR fMRI. However, the oscillatory nature of the signal leads to an increased number of acquisitions. To improve temporal resolution and accurately model the nonlinearity of OSSI signals, we build the MR physics for OSSI signal generation as a regularizer for the undersampled reconstruction rather than using subspace models that are not well suited for the data. Our proposed physics-based manifold model turns the disadvantages of OSSI acquisition into advantages and enables joint reconstruction and quantification. OSSI manifold model (OSSIMM) outperforms subspace models and reconstructs high-resolution fMRI images with a factor of 12 acceleration and without spatial or temporal resolution smoothing. Furthermore, OSSIMM can dynamically quantify important physics parameters, including $R_2^*$ maps, with a temporal resolution of 150 ms.


title: Yelp Dataset Analysis using Scalable Big Data

abstract: Yelp has served and will continue to serve as a data-driven application. Yelp has published a dataset containing business information, reviews, user information, and check-in information. This paper will examine this dataset to provide descriptive analytics to understand business performance, geo-spatial distribution of businesses, reviewers' rating and other characteristics, and temporal distribution of check-ins in business premises. With these analysis we are able to establish that yelp reviews, tips, elite users and check ins have started to plummet over the years. Coincidentally, the paper also establishes that Canadians have a more stable star ratings as well as sentiment ratings when compared to Americans.


title: Fermionic and bosonic fluctuation-dissipation theorem from a deformed AdS holographic model at finite temperature and chemical potential

abstract: In this work we study fluctuations and dissipation of a string in a deformed anti-de Sitter (AdS) space at finite temperature and density. The deformed AdS space is a charged black hole solution of the Einstein-Maxwell-Dilaton action. In this background we take into account the backreaction on the horizon function from an exponential deformation of the AdS space. From this model we compute the admittance and study the influence of the temperature and the chemical potential on it. We calculate the two-point correlations functions, and the mean square displacement for bosonic and fermionic cases, from which we obtain the short and large time approximations. For the long time, we obtain a sub-diffusive regime $\sim \log t$. Combining the results from the admittance and the correlations functions we check the fluctuation-dissipation theorem for bosonic and fermionic systems.


title: Re-TACRED: Addressing Shortcomings of the TACRED Dataset

abstract: TACRED is one of the largest and most widely used sentence-level relation extraction datasets. Proposed models that are evaluated using this dataset consistently set new state-of-the-art performance. However, they still exhibit large error rates despite leveraging external knowledge and unsupervised pretraining on large text corpora. A recent study suggested that this may be due to poor dataset quality. The study observed that over 50% of the most challenging sentences from the development and test sets are incorrectly labeled and account for an average drop of 8% f1-score in model performance. However, this study was limited to a small biased sample of 5k (out of a total of 106k) sentences, substantially restricting the generalizability and broader implications of its findings. In this paper, we address these shortcomings by: (i) performing a comprehensive study over the whole TACRED dataset, (ii) proposing an improved crowdsourcing strategy and deploying it to re-annotate the whole dataset, and (iii) performing a thorough analysis to understand how correcting the TACRED annotations affects previously published results. After verification, we observed that 23.9% of TACRED labels are incorrect. Moreover, evaluating several models on our revised dataset yields an average f1-score improvement of 14.3% and helps uncover significant relationships between the different models (rather than simply offsetting or scaling their scores by a constant factor). Finally, aside from our analysis we also release Re-TACRED, a new completely re-annotated version of the TACRED dataset that can be used to perform reliable evaluation of relation extraction models.


title: A self-consistent refractive index model for fast simulation of free-electron lasers

abstract: Modern x-ray free-electron lasers (XFELs) produce x-ray pulses of exceptional transverse coherence. This is due largely to the process of optical guiding by which the radiation is both refractively guided by the bunched electron beam and gain guided by the preferential amplification of on-axis radiation. These effects may be summarized by an effective index of refraction, which has been used in the past to study the transverse dynamics of the FEL process with significant simplifications and approximations, but never fully self-consistently. We present here a self-consistent method for studying high gain FELs in the linear regime by approximating the FEL equations to second-order in the lateral displacement from the nominal electron beam axis. This is made possible by casting the FEL equations in the language of optical fibers with an appropriately chosen refractive index. We demonstrate that this approach is both fast and highly accurate, indicating that the most important FEL dynamics are inherently second-order. In its full form our method can capture the effects of transverse offsets in both the x-ray beam and the electron beam, making it a versatile tool for studying non-ideal effects in seeded FELs, regenerative amplifier XFELs, and even self-amplified spontaneous emission (SASE) FELs.


title: Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs

abstract: Abstractive conversation summarization has received much attention recently. However, these generated summaries often suffer from insufficient, redundant, or incorrect content, largely due to the unstructured and complex characteristics of human-human interactions. To this end, we propose to explicitly model the rich structures in conversations for more precise and accurate conversation summarization, by first incorporating discourse relations between utterances and action triples ("who-doing-what") in utterances through structured graphs to better encode conversations, and then designing a multi-granularity decoder to generate summaries by combining all levels of information. Experiments show that our proposed models outperform state-of-the-art methods and generalize well in other domains in terms of both automatic evaluations and human judgments. We have publicly released our code at https://github.com/GT-SALT/Structure-Aware-BART.


title: Enriching a Model's Notion of Belief using a Persistent Memory

abstract: Although pretrained language models (PTLMs) have been shown to contain significant amounts of world knowledge, they can still produce inconsistent answers to questions when probed, even after using specialized training techniques to reduce inconsistency. As a result, it can be hard to identify what the model actually "believes" about the world. Our goal is to reduce this problem, so systems are more globally consistent and accurate in their answers. Our approach is to add a memory component -- a BeliefBank -- that records a model's answers, and two mechanisms that use it to improve consistency among beliefs. First, a reasoning component -- a weighted SAT solver -- improves consistency by flipping answers that significantly clash with others. Second, a feedback component re-queries the model but using known beliefs as context. We show that, in a controlled experimental setting, these two mechanisms improve both accuracy and consistency. This is significant as it is a first step towards endowing models with an evolving memory, allowing them to construct a more coherent picture of the world.


title: Regularized Maximum Likelihood Estimation for the Random Coefficients Model

abstract: The random coefficients model $Y_i={\beta_0}_i+{\beta_1}_i {X_1}_i+{\beta_2}_i {X_2}_i+\ldots+{\beta_d}_i {X_d}_i$, with $\mathbf{X}_i$, $Y_i$, $\mathbf{\beta}_i$ i.i.d, and $\mathbf{\beta}_i$ independent of $X_i$ is often used to capture unobserved heterogeneity in a population. We propose a quasi-maximum likelihood method to estimate the joint density distribution of the random coefficient model. This method implicitly involves the inversion of the Radon transformation in order to reconstruct the joint distribution, and hence is an inverse problem. Nonparametric estimation for the joint density of $\mathbf{\beta}_i=({\beta_0}_i,\ldots, {\beta_d}_i)$ based on kernel methods or Fourier inversion have been proposed in recent years. Most of these methods assume a heavy tailed design density $f_\mathbf{X}$. To add stability to the solution, we apply regularization methods. We analyze the convergence of the method without assuming heavy tails for $f_\mathbf{X}$ and illustrate performance by applying the method on simulated and real data. To add stability to the solution, we apply a Tikhonov-type regularization method.


title: Accurate 3D Facial Geometry Prediction by Multi-Task, Multi-Modal, and Multi-Representation Landmark Refinement Network

abstract: This work focuses on complete 3D facial geometry prediction, including 3D facial alignment via 3D face modeling and face orientation estimation using the proposed multi-task, multi-modal, and multi-representation landmark refinement network (M$^3$-LRN). Our focus is on the important facial attributes, 3D landmarks, and we fully utilize their embedded information to guide 3D facial geometry learning. We first propose a multi-modal and multi-representation feature aggregation for landmark refinement. Next, we are the first to study 3DMM regression from sparse 3D landmarks and utilize multi-representation advantage to attain better geometry prediction. We attain the state of the art from extensive experiments on all tasks of learning 3D facial geometry. We closely validate contributions of each modality and representation. Our results are robust across cropped faces, underwater scenarios, and extreme poses. Specially we adopt only simple and widely used network operations in M$^3$-LRN and attain a near 20\% improvement on face orientation estimation over the current best performance. See our project page here.


title: Wireless Information and Power Transfer for IoT: Pulse Position Modulation, Integrated Receiver, and Experimental Validation

abstract: Simultaneous wireless information and power transfer (SWIPT) has emerged as a viable technique to energize and connect low-power autonomous devices and enable future Internet of Things (IoT). A major challenge of SWIPT is the energy consumption of the receiver of such low-power devices. An attractive low-power solution consists in an integrated information decoder (ID) and energy harvester (EH) architecture for SWIPT receiver (IntRx) where the received RF signal is first rectified before being used for information decoding. Such architecture eliminates the need for energy-consuming RF components such as local oscillators and mixers. This paper proposes a novel modulation and demodulation method for the IntRx SWIPT architecture based on pulse position modulation (PPM) where information is encoded in the position of the pulse. The new method transmits high amplitude pulses to increase the Peak-to-Average Power Ratio (PAPR) of the transmit signal and exploits the EH's nonlinearity so as to boost the harvested DC power. Simultaneously, the information can be decoded from the rectifier signal by simply finding the position of the pulse in a certain symbol duration. We have analyzed both the information and the power transfer performance of the newly proposed PPM for IntRx SWIPT theoretically, numerically, and experimentally. To that end, we have established a SWIPT system testbed in an indoor environment by prototyping a base station to transfer information-power signal and the IntRx SWIPT receiver including ID and EH blocks. The performance evaluation of the PPM was carried out in various conditions, and the results have been compared and contrasted to conventional signals. Theoretical, numerical, and experimental results highlight the significant benefits of the proposed PPM scheme to enhance the power transfer performance and operate information decoding with low-power consumption.


title: LAMPRET: Layout-Aware Multimodal PreTraining for Document Understanding

abstract: Document layout comprises both structural and visual (eg. font-sizes) information that is vital but often ignored by machine learning models. The few existing models which do use layout information only consider textual contents, and overlook the existence of contents in other modalities such as images. Additionally, spatial interactions of presented contents in a layout were never really fully exploited. To bridge this gap, we parse a document into content blocks (eg. text, table, image) and propose a novel layout-aware multimodal hierarchical framework, LAMPreT, to model the blocks and the whole document. Our LAMPreT encodes each block with a multimodal transformer in the lower-level and aggregates the block-level representations and connections utilizing a specifically designed transformer at the higher-level. We design hierarchical pretraining objectives where the lower-level model is trained similarly to multimodal grounding models, and the higher-level model is trained with our proposed novel layout-aware objectives. We evaluate the proposed model on two layout-aware tasks -- text block filling and image suggestion and show the effectiveness of our proposed hierarchical architecture as well as pretraining techniques.


title: Complexity guarantees for an implicit smoothing-enabled method for stochastic MPECs

abstract: Stochastic MPECs have found increasing relevance for modeling a broad range of settings in engineering and statistics. Yet, there seem to be no efficient first/zeroth-order schemes equipped with non-asymptotic rate guarantees for resolving even deterministic variants of such problems. We consider SMPECs where the parametrized lower-level equilibrium problem is given by a deterministic/stochastic VI problem whose mapping is strongly monotone. We develop a zeroth-order implicit algorithmic framework by leveraging a locally randomized spherical smoothing scheme. We present schemes for single-stage and two-stage stochastic MPECs when the upper-level problem is either convex or nonconvex. (I). Single-stage SMPECs: In convex regimes, our proposed inexact schemes are characterized by a complexity in upper-level projections, upper-level samples, and lower-level projections of $\mathcal{O}(\tfrac{1}{\epsilon^2})$, $\mathcal{O}(\tfrac{1}{\epsilon^2})$, and $\mathcal{O}(\tfrac{1}{\epsilon^2}\ln(\tfrac{1}{\epsilon}))$ , respectively. Analogous bounds for the nonconvex regime are $\mathcal{O}(\tfrac{1}{\epsilon})$, $\mathcal{O}(\tfrac{1}{\epsilon^2})$, and $\mathcal{O}(\tfrac{1}{\epsilon^3})$, respectively . (II). Two-stage SMPECs: In convex regimes, our proposed inexact schemes have a complexity in upper-level projections, upper-level samples, and lower-level projections of $\mathcal{O}(\tfrac{1}{\epsilon^2}),\mathcal{O}(\tfrac{1}{\epsilon^2})$, and $\mathcal{O}(\tfrac{1}{\epsilon^2}\ln(\tfrac{1}{\epsilon}))$ while the corresponding bounds in the nonconvex regime are $\mathcal{O}(\tfrac{1}{\epsilon})$, $\mathcal{O}(\tfrac{1}{\epsilon^2})$, and $\mathcal{O}(\tfrac{1}{\epsilon^2}\ln(\tfrac{1}{\epsilon}))$ , respectively . In addition, we derive statements for exact as well as accelerated counterparts. We also provide a comprehensive set of numerical results for validating the theoretical findings.


title: An extension of basic Humbert hypergeometric functions

abstract: Given the growing quantity of proposals and works of basic hypergeometric functions in the scope of $q$-calculus, it is important to introduce a systematic classification of $q$-calculus. Our aim in this article is to investigate certain interesting several $q$-partial derivative formulas, $q$-contiguous function relations, $q$-recurrence relations, various $q$-partial differential equations, summation formulas, transformation formulas and $q$-integrals representations for basic Humbert confluent hypergeometric functions under what constraints of parameters. These interesting properties, as special cases, include many known expansions of basic Humbert hypergeometric functions, and are also include particular interest in the area.


title: Generalized Matrix Decomposition Regression: Estimation and Inference for Two-way Structured Data

abstract: This paper studies high-dimensional regression with two-way structured data. To estimate the high-dimensional coefficient vector, we propose the generalized matrix decomposition regression (GMDR) to efficiently leverage any auxiliary information on row and column structures. The GMDR extends the principal component regression (PCR) to two-way structured data, but unlike PCR, the GMDR selects the components that are most predictive of the outcome, leading to more accurate prediction. For inference on regression coefficients of individual variables, we propose the generalized matrix decomposition inference (GMDI), a general high-dimensional inferential framework for a large family of estimators that include the proposed GMDR estimator. GMDI provides more flexibility for modeling relevant auxiliary row and column structures. As a result, GMDI does not require the true regression coefficients to be sparse; it also allows dependent and heteroscedastic observations. We study the theoretical properties of GMDI in terms of both the type-I error rate and power and demonstrate the effectiveness of GMDR and GMDI on simulation studies and an application to human microbiome data.


title: Model-Based Deep Autoencoder Networks for Nonlinear Hyperspectral Unmixing

abstract: Autoencoder (AEC) networks have recently emerged as a promising approach to perform unsupervised hyperspectral unmixing (HU) by associating the latent representations with the abundances, the decoder with the mixing model and the encoder with its inverse. AECs are especially appealing for nonlinear HU since they lead to unsupervised and model-free algorithms. However, existing approaches fail to explore the fact that the encoder should invert the mixing process, which might reduce their robustness. In this paper, we propose a model-based AEC for nonlinear HU by considering the mixing model a nonlinear fluctuation over a linear mixture. Differently from previous works, we show that this restriction naturally imposes a particular structure to both the encoder and to the decoder networks. This introduces prior information in the AEC without reducing the flexibility of the mixing model. Simulations with synthetic and real data indicate that the proposed strategy improves nonlinear HU.


title: Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models

abstract: There is growing evidence that pretrained language models improve task-specific fine-tuning not just for the languages seen in pretraining, but also for new languages and even non-linguistic data. What is the nature of this surprising cross-domain transfer? We offer a partial answer via a systematic exploration of how much transfer occurs when models are denied any information about word identity via random scrambling. In four classification tasks and two sequence labeling tasks, we evaluate baseline models, LSTMs using GloVe embeddings, and BERT. We find that only BERT shows high rates of transfer into our scrambled domains, and for classification but not sequence labeling tasks. Our analyses seek to explain why transfer succeeds for some tasks but not others, to isolate the separate contributions of pretraining versus fine-tuning, and to quantify the role of word frequency. These findings help explain where and why cross-domain transfer occurs, which can guide future studies and practical fine-tuning efforts.


title: On the equivalence between weak BMO and the space of derivatives of the Zygmund class

abstract: In this paper, we will discuss the space of functions of weak bounded mean oscillation. In particular, we will show that this space is the dual space of the special atom space, whose dual space was already known to be the space of derivative of functions (in the sense of distribution) belonging to the Zygmund class of functions. We show in particular that this proves that the Hardy space $H^1$ strictly contains the space special atom space.


title: Waiting-time dependent non-equilibrium phase diagram of simple glass- and gel-forming liquids

abstract: Under many circumstances many soft and hard materials are present in a puzzling wealth of non-equilibrium amorphous states, whose properties are not stationary and depend on preparation. They are often summarized in unconventional "phase diagrams" that exhibit new "phases" and/or "transitions", in which the time, however, is an essential variable. This work proposes a solution to the problem of theoretically defining and predicting these non-equilibrium phases and their time-evolving phase diagrams, given the underlying molecular interactions. We demonstrate that these non-equilibrium phases and the corresponding non-stationary (i.e., aging) phase diagrams can indeed be defined and predicted using the kinetic perspective of a novel non-equilibrium statistical mechanical theory of irreversible processes. This is illustrated with the theoretical description of the transient process of dynamic arrest into non-equilibrium amorphous solid phases, of an instantaneously-quenched simple model fluid involving repulsive hard-sphere plus attractive square well pair interactions.


title: Sequential Cross-Document Coreference Resolution

abstract: Relating entities and events in text is a key component of natural language understanding. Cross-document coreference resolution, in particular, is important for the growing interest in multi-document analysis tasks. In this work we propose a new model that extends the efficient sequential prediction paradigm for coreference resolution to cross-document settings and achieves competitive results for both entity and event coreference while provides strong evidence of the efficacy of both sequential models and higher-order inference in cross-document settings. Our model incrementally composes mentions into cluster representations and predicts links between a mention and the already constructed clusters, approximating a higher-order model. In addition, we conduct extensive ablation studies that provide new insights into the importance of various inputs and representation types in coreference.


title: High-performance lasers for fully integrated silicon nitride photonics

abstract: Silicon nitride (SiN) waveguides with ultra-low optical loss enable integrated photonic applications including low noise, narrow linewidth lasers, chip-scale nonlinear photonics, and microwave photonics. Lasers are key components to SiN photonic integrated circuits (PICs), but are difficult to fully integrate with low-index SiN waveguides due to their large mismatch with the high-index III-V gain materials. The recent demonstration of multilayer heterogeneous integration provides a practical solution and enabled the first-generation of lasers fully integrated with SiN waveguides. However a laser with high device yield and high output power at telecommunication wavelengths, where photonics applications are clustered, is still missing, hindered by large mode transition loss, nonoptimized cavity design, and a complicated fabrication process. Here, we report high-performance lasers on SiN with tens of milliwatts output through the SiN waveguide and sub-kHz fundamental linewidth, addressing all of the aforementioned issues. We also show Hertz-level linewidth lasers are achievable with the developed integration techniques. These lasers, together with high-$Q$ SiN resonators, mark a milestone towards a fully-integrated low-noise silicon nitride photonics platform. This laser should find potential applications in LIDAR, microwave photonics and coherent optical communications.


title: Risk score learning for COVID-19 contact tracing apps

abstract: Digital contact tracing apps for COVID, such as the one developed by Google and Apple, need to estimate the risk that a user was infected during a particular exposure, in order to decide whether to notify the user to take precautions, such as entering into quarantine, or requesting a test. Such risk score models contain numerous parameters that must be set by the public health authority. In this paper, we show how to automatically learn these parameters from data. Our method needs access to exposure and outcome data. Although this data is already being collected (in an aggregated, privacy-preserving way) by several health authorities, in this paper we limit ourselves to simulated data, so that we can systematically study the different factors that affect the feasibility of the approach. In particular, we show that the parameters become harder to estimate when there is more missing data (e.g., due to infections which were not recorded by the app), and when there is model misspecification. Nevertheless, the learning approach outperforms a strong manually designed baseline. Furthermore, the learning approach can adapt even when the risk factors of the disease change, e.g., due to the evolution of new variants, or the adoption of vaccines.


title: Boosting Memory Access Locality of the Spectral Element Method with Hilbert Space-Filling Curves

abstract: We propose an algorithm based on Hilbert space-filling curves to reorder mesh elements in memory for use with the Spectral Element Method, aiming to attain fewer cache misses, better locality of data reference and faster execution. We present a technique to numerically simulate acoustic wave propagation in 2D domains using the Spectral Element Method, and discuss computational performance aspects of this procedure. We reorder mesh-related data via Hilbert curves to achieve sizable reductions in execution time under several mesh configurations in shared-memory systems. Our experiments show that the Hilbert curve approach works well with meshes of several granularities and also with small and large variations in element sizes, achieving reductions between 9% and 25% in execution time when compared to three other ordering schemes.


title: Joint Beamforming Design for Multiuser MISO Downlink Aided by a Reconfigurable Intelligent Surface and a Relay

abstract: Reconfigurable intelligent surfaces (RIS) have drawn considerable attention recently due to their controllable scattering elements that are able to direct electromagnetic waves into desirable directions. Although RISs share some similarities with relays, the two have fundamental differences impacting their performance. To harness the benefits of both relaying and RISs, a multi-user communication system is proposed in this paper wherein a relay and an RIS cooperate to improve performance in terms of energy efficiency. Using singular value decomposition (SVD), semidefinite programming (SDP), and function approximations, we propose different solutions for optimizing the beamforming matrices at the base-station (BS), the relay, and the phase shifts at the RIS to minimize the total transmit power subject to quality-of-service (QoS) constraints. The problem is solved in different cases when the relay operates in half-duplex and full-duplex modes and when the reflecting elements have continuous and discrete phase shifts. Simulation results are provided to compare the performance of the system with and without the RIS or the relay in both full-duplex and half-duplex modes, under different optimization solutions. Generally, the results show that the system with full-duplex relay and RIS cooperation outperforms all the other scenarios, and the contribution of full-duplex relay is higher than that of the RIS. However, an RIS performs better than a half-duplex relay when the required QoS is high. The results also show that increasing the number of RIS reflecting elements improves performance better in the presence of a relay than in its absence.


title: FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modelling

abstract: We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground objects from their varying backgrounds. We achieve this via a 2-component NeRF model, FiG-NeRF, that prefers explanation of the scene as a geometrically constant background and a deformable foreground that represents the object category. We show that this method can learn accurate 3D object category models using only photometric supervision and casually captured images of the objects. Additionally, our 2-part decomposition allows the model to perform accurate and crisp amodal segmentation. We quantitatively evaluate our method with view synthesis and image fidelity metrics, using synthetic, lab-captured, and in-the-wild data. Our results demonstrate convincing 3D object category modelling that exceed the performance of existing methods.


title: TIE: A Framework for Embedding-based Incremental Temporal Knowledge Graph Completion

abstract: Reasoning in a temporal knowledge graph (TKG) is a critical task for information retrieval and semantic search. It is particularly challenging when the TKG is updated frequently. The model has to adapt to changes in the TKG for efficient training and inference while preserving its performance on historical knowledge. Recent work approaches TKG completion (TKGC) by augmenting the encoder-decoder framework with a time-aware encoding function. However, naively fine-tuning the model at every time step using these methods does not address the problems of 1) catastrophic forgetting, 2) the model's inability to identify the change of facts (e.g., the change of the political affiliation and end of a marriage), and 3) the lack of training efficiency. To address these challenges, we present the Time-aware Incremental Embedding (TIE) framework, which combines TKG representation learning, experience replay, and temporal regularization. We introduce a set of metrics that characterizes the intransigence of the model and propose a constraint that associates the deleted facts with negative labels. Experimental results on Wikidata12k and YAGO11k datasets demonstrate that the proposed TIE framework reduces training time by about ten times and improves on the proposed metrics compared to vanilla full-batch training. It comes without a significant loss in performance for any traditional measures. Extensive ablation studies reveal performance trade-offs among different evaluation metrics, which is essential for decision-making around real-world TKG applications.


title: Robust Embeddings Via Distributions

abstract: Despite recent monumental advances in the field, many Natural Language Processing (NLP) models still struggle to perform adequately on noisy domains. We propose a novel probabilistic embedding-level method to improve the robustness of NLP models. Our method, Robust Embeddings via Distributions (RED), incorporates information from both noisy tokens and surrounding context to obtain distributions over embedding vectors that can express uncertainty in semantic space more fully than any deterministic method. We evaluate our method on a number of downstream tasks using existing state-of-the-art models in the presence of both natural and synthetic noise, and demonstrate a clear improvement over other embedding approaches to robustness from the literature.


title: Emergence of intrinsically isolated flat bands and their topology in fully relaxed twisted multi-layer graphene

abstract: We study the electronic structure and band topology of fully relaxed twisted multi-layer graphene (TMLG). Isolated flat bands emerge in TMLG with the number of layers [$M+N$ with $M$ the layer number of the bottom few-layer graphene (FLG)] up to 10 and with various stacking orders, and most of them are on the hole side. The touched bands of FLGs around the Fermi level are split by the moir\'{e} coupling through the electron-hole asymmetry in low-energy bands of FLGs and by the vertical hopping between next-nearest layers. The full structural relaxation leads to global gaps that completely isolate a flat band. For TMLG with given $M$ and $N$, the highest magnitude of Chern numbers ($|C|$) of the separable flat bands reaches $M+N-1$ and can be hosted by certain isolated bands. The $|C|=9$ occurs in the isolated flat valence band of several configurations with 10 layers. Such high $|C|$ originates from the lifting of the band-state degeneracy in the weak regime of moir\'{e} coupling or from the topological phase transitions induced by the strong moir\'{e} coupling. Moreover, large orbital magnetic moments arise in isolated flat bands with high $|C|$ and depend on the structural configurations of TMLG.


title: Fashion-Guided Adversarial Attack on Person Segmentation

abstract: This paper presents the first adversarial example based method for attacking human instance segmentation networks, namely person segmentation networks in short, which are harder to fool than classification networks. We propose a novel Fashion-Guided Adversarial Attack (FashionAdv) framework to automatically identify attackable regions in the target image to minimize the effect on image quality. It generates adversarial textures learned from fashion style images and then overlays them on the clothing regions in the original image to make all persons in the image invisible to person segmentation networks. The synthesized adversarial textures are inconspicuous and appear natural to the human eye. The effectiveness of the proposed method is enhanced by robustness training and by jointly attacking multiple components of the target network. Extensive experiments demonstrated the effectiveness of FashionAdv in terms of robustness to image manipulations and storage in cyberspace as well as appearing natural to the human eye. The code and data are publicly released on our project page https://github.com/nii-yamagishilab/fashion_adv


title: A two-component model of hadron production applied to $\bf p_t$ spectra from 5 TeV and 13 TeV $\bf p$-$\bf p$ collisions at the large hadron collider

abstract: The ALICE collaboration at the large hadron collider (LHC) recently reported high-statistics $p_t$ spectrum data from 5 TeV and 13 TeV $p$-$p$ collisions. Particle data for each energy were partitioned into event classes based on the total yields within two disjoint pseudorapidity $\eta$ intervals denoted by acronyms V0M and SPD. For each energy the spectra resulting from the two selection methods were then compared to a minimum-bias INEL $> 0$ average over the entire event population. The nominal goal was determination of the role of jets in high-multiplicity $p$-$p$ collisions and especially the jet contribution to the low-$p_t$ parts of spectra. A related motivation was response to recent claims of "collective" behavior and other nominal indicators of quark-gluon plasma (QGP) formation in small collision systems. In the present study a two-component (soft + hard) model (TCM) of hadron production in $p$-$p$ collisions is applied to the ALICE spectrum data. As in previous TCM studies of a variety of A-B collision systems the jet and nonjet contributions to $p$-$p$ spectra are accurately separated over the entire $p_t$ acceptance. Distinction is maintained among spectrum normalizations, jet contributions to spectra and systematic biases resulting from V0M and SPD event selection. The statistical significance of data-model differences is established. The effect of {\em spherocity} (azimuthal asymmetry measure nominally sensitive to jet production) on ensemble-mean $p_t$ vs event multiplicity $n_{ch}$ is investigated and found to have little relation to jet production. The general results of the TCM analysis are as expected from a conventional QCD description of jet production in $p$-$p$ collisions.


title: Periodicity of quantum walks defined by mixed paths and mixed cycles

abstract: In this paper, we determine periodicity of quantum walks defined by mixed paths and mixed cycles. By the spectral mapping theorem of quantum walks, consideration of periodicity is reduced to eigenvalue analysis of $\eta$-Hermitian adjacency matrices. First, we investigate coefficients of the characteristic polynomials of $\eta$-Hermitian adjacency matrices. We show that the characteristic polynomials of mixed trees and their underlying graphs are same. We also define $n+1$ types of mixed cycles and show that every mixed cycle is switching equivalent to one of them. We use these results to discuss periodicity. We show that the mixed paths are periodic for any $\eta$. In addition, we provide a necessary and sufficient condition for a mixed cycle to be periodic and determine their periods.


title: Electronic instabilities of kagome metals: saddle points and Landau theory

abstract: We study electronic instabilities of a kagome metal with a Fermi energy close to saddle points at the hexagonal Brillouin zone face centers. Using parquet renormalization group, we determine the leading and subleading instabilities, finding superconducting, charge, orbital moment, and spin density waves. We then derive and use Landau theory to discuss how different primary density wave orders give rise to charge density wave modulations, as seen in the AV$_3$Sb$_5$ family, with A=K,Rb,Cs. The results provide strong constraints on the mechanism of charge ordering and how it can be further refined from existing and future experiments.


title: Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks

abstract: In this paper, we introduce a new approach based on distance fields to exactly impose boundary conditions in physics-informed deep neural networks. The challenges in satisfying Dirichlet boundary conditions in meshfree and particle methods are well-known. This issue is also pertinent in the development of physics informed neural networks (PINN) for the solution of partial differential equations. We introduce geometry-aware trial functions in artifical neural networks to improve the training in deep learning for partial differential equations. To this end, we use concepts from constructive solid geometry (R-functions) and generalized barycentric coordinates (mean value potential fields) to construct $\phi$, an approximate distance function to the boundary of a domain. To exactly impose homogeneous Dirichlet boundary conditions, the trial function is taken as $\phi$ multiplied by the PINN approximation, and its generalization via transfinite interpolation is used to a priori satisfy inhomogeneous Dirichlet (essential), Neumann (natural), and Robin boundary conditions on complex geometries. In doing so, we eliminate modeling error associated with the satisfaction of boundary conditions in a collocation method and ensure that kinematic admissibility is met pointwise in a Ritz method. We present numerical solutions for linear and nonlinear boundary-value problems over domains with affine and curved boundaries. Benchmark problems in 1D for linear elasticity, advection-diffusion, and beam bending; and in 2D for the Poisson equation, biharmonic equation, and the nonlinear Eikonal equation are considered. The approach extends to higher dimensions, and we showcase its use by solving a Poisson problem with homogeneous Dirichlet boundary conditions over the 4D hypercube. This study provides a pathway for meshfree analysis to be conducted on the exact geometry without domain discretization.