title: Finite-dimensional signature of spinodal instability in an athermal hysteretic transition

abstract: We study the off-equilibrium critical phenomena across a hysteretic first-order transition in disordered athermal systems. The study focuses on the zero temperature random field Ising model (ZTRFIM) above the critical disorder for spatial dimensions $d=2,3,$ and $4$. We use Monte Carlo simulations to show that disorder suppresses critical slowing down in phase ordering time for finite-dimensional systems. The dynamic hysteresis scaling, the measure of explicit finite-time scaling, is used to subsequently quantify the critical slowing down. The scaling exponents in all dimensions increase with disorder strength and finally reach a stable value where the transformation is no longer critical. The associated critical behavior in the mean-field limit is very different, where the exponent values for various disorders in all dimensions are similar. The non-mean-field exponents asymptotically approach the mean-field value ($\Upsilon \approx 2/3$) with increase in dimensions. The results suggest that the critical features in the hysteretic metastable phase are controlled by inherent mean-field spinodal instability that gets blurred by disorder in low-dimension athermal systems.


title: Optical variability of eight FRII-type quasars with 13-yr photometric light curves

abstract: We characterize the optical variability properties of eight lobe-dominated radio quasars (QSOs): B2 0709$+$37, FBQS J095206.3$+$235245, PG 1004$+$130, [HB89] 1156$+$631, [HB89] 1425$+$267, [HB89] 1503$+$691, [HB89] 1721$+$343, 4C $+$74.26, systematically monitored for a duration of 13 years since 2009. The quasars are radio-loud objects with extended radio lobes that indicate their orientation close to the sky plane. Five of the eight QSOs are classified as giant radio quasars. All quasars showed variability during our monitoring, with magnitude variations between 0.3 and 1 mag for the least variable and the most variable QSO, respectively. We performed both structure function (SF) analysis and power spectrum density (PSD) analysis for the variability characterization and search for characteristic timescales and periodicities. As a result of our analysis, we obtained relatively steep SF slopes ($\alpha$ ranging from 0.49 to 0.75) that are consistent with the derived PSD slopes ($\sim$2--3). All the PSDs show a good fit to single power law forms, indicating a red-noise character of variability between $\sim$13 years and weeks timescales. We did not measure reliable characteristic timescales of variability from the SF analysis which indicates that the duration of the gathered data is too short to reveal them. The absence of bends in the PSDs (change of slope from $\geq$1 to $\sim$0) on longer timescales indicates that optical variations are most likely caused by thermal instabilities in the accretion disk.


title: Selection and Ordering Policies for Hiring Pipelines via Linear Programming

abstract: Motivated by hiring pipelines, we study three selection and ordering problems in which applicants for a finite set of positions must be interviewed or sent offers. There is a finite time budget for interviewing/sending offers, and every interview/offer is followed by a stochastic realization of discovering the applicant's quality or acceptance decision, leading to computationally challenging problems. In the first problem, we study sequential interviewing and show that a computationally tractable, non-adaptive policy that must make offers immediately after interviewing is near-optimal, assuming offers are always accepted. We further show how to use this policy as a subroutine for obtaining a PTAS. In the second problem, we assume that applicants have already been interviewed but only accept offers with some probability; we develop a computationally tractable policy that makes offers for the different positions in parallel, which can be used even if positions are heterogeneous, and is near-optimal relative to a policy that can make the same total number of offers one by one. In the third problem, we introduce a parsimonious model of overbooking where all offers must be sent simultaneously and a linear penalty is incurred for each acceptance beyond the number of positions; we provide nearly tight bounds on the performance of practically motivated value-ordered policies. All in all, our paper takes a unified approach to three different hiring problems, based on linear programming. Our results in the first two problems generalize and improve the existing guarantees due to Purohit et al. (2019) that were between 1/8 and 1/2 to new guarantees that are at least 1-1/e. We also numerically compare three different settings of making offers to candidates (sequentially, in parallel, or simultaneously), providing insight into when a firm should favor each one.


title: A convolution inequality, yielding a sharper Berry-Esseen theorem for summands Zolotarev-close to normal

abstract: The classical Berry-Esseen error bound, for the normal approximation to the law of a sum of independent and identically distributed random variables, is here improved by replacing the standardised third absolute moment by a weak norm distance to normality. We thus sharpen and simplify two results of Ulyanov (1976) and of Senatov (1998), each of them previously optimal, in the line of research initiated by Zolotarev (1965) and Paulauskas (1969). Our proof is based on a seemingly incomparable normal approximation theorem of Zolotarev (1986), combined with our main technical result: The Kolmogorov distance (supremum norm of difference of distribution functions) between a convolution of two laws and a convolution of two Lipschitz laws is bounded homogeneously of degree 1 in the pair of the Wasserstein distances (L$^1$ norms of differences of distribution functions) of the corresponding factors, and also, inessentially for the present application, in the pair of the Lipschitz constants. Side results include a short introduction to $\zeta$ norms on the real line, simpler inequalities for various probability distances, slight improvements of the theorem of Zolotarev (1986) and of a lower bound theorem of Bobkov, Chistyakov and G\"otze (2012), an application to sampling from finite populations, auxiliary results on rounding and on winsorisation, and computations of a few examples. The introductory section in particular is aimed at analysts in general rather than specialists in probability approximations.


title: A General Security Approach for Soft-information Decoding against Smart Bursty Jammers

abstract: Malicious attacks such as jamming can cause significant disruption or complete denial of service (DoS) to wireless communication protocols. Moreover, jamming devices are getting smarter, making them difficult to detect. Forward error correction, which adds redundancy to data, is commonly deployed to protect communications against the deleterious effects of channel noise. Soft-information error correction decoders obtain reliability information from the receiver to inform their decoding, but in the presence of a jammer such information is misleading and results in degraded error correction performance. As decoders assume noise occurs independently to each bit, a bursty jammer will lead to greater degradation in performance than a non-bursty one. Here we establish, however, that such temporal dependencies can aid inferences on which bits have been subjected to jamming, thus enabling counter-measures. In particular, we introduce a pre-decoding processing step that updates log-likelihood ratio (LLR) reliability information to reflect inferences in the presence of a jammer, enabling improved decoding performance for any soft detection decoder. The proposed method requires no alteration to the decoding algorithm. Simulation results show that the method correctly infers a significant proportion of jamming in any received frame. Results with one particular decoding algorithm, the recently introduced ORBGRAND, show that the proposed method reduces the block-error rate (BLER) by an order of magnitude for a selection of codes, and prevents complete DoS at the receiver.


title: CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning

abstract: Speech is the surface form of a finite set of phonetic units, which can be represented by discrete codes. We propose the Code BERT (CoBERT) approach for self-supervised speech representation learning. The idea is to convert an utterance to a sequence of discrete codes, and perform code representation learning, where we predict the code representations based on a masked view of the original speech input. Unlike the prior self-distillation approaches of which the teacher and the student are of the same modality, our target model predicts representations from a different modality. CoBERT outperforms the most recent state-of-the-art performance on the ASR task and brings significant improvements on the SUPERB speech translation (ST) task. Our code and models are released at https://github.com/mct10/CoBERT.


title: Gravitational Waves of Type III Shapovalov Spacetimes: Particle Trajectories, Geodesic Deviation and Tidal Accelerations

abstract: For gravitational-wave spacetimes of Shapovalov type III, exact general solutions of geodesic deviation equations and equations of motion of test particles are obtained. Solutions are found in a privileged coordinate system, where the metric of the considered spacetime models depends on the wave variable. The exact form of tidal accelerations of the gravitational wave is obtained. In the considered wave models of spacetime, the complete integral of the Hamilton-Jacobi equations of test particles can be constructed. An explicit form of the equations for the transition to a synchronous coordinate system is found, where the proper time of a test particle on the base geodesic is chosen as the time variable, and the time and space variables are separated. In the synchronous coordinate system, the form of the metric of the considered wave spacetime is presented, the form of the geodesic deviation vector and the tidal acceleration vector are obtained. The methods used in the paper and the results obtained are applicable to gravitational waves both in the general theory of relativity and in modified theories of gravity. The proposed approaches are applied to the case of Einstein's vacuum equations.


title: Study and security analysis of the Spanish identity card

abstract: The National Identity Document is a fundamental piece of documentation for the identification of citizens throughout the world. That is precisely the case of the DNI (Documento Nacional de Identidad) of Spain. Its importance has been enhanced in recent years with the addition of a chip for the authentication of users within telematic administrative services. Thus, the document has since been called: electronic DNI or simply DNIe. Sensitive user information is stored in that integrated circuit, such as personal and biometric data, along with signature and authentication certificates. Some of the functionalities of the DNIe in its current version at the time of writing this work have been implemented for years in the DNI 3.0 version launched in 2015, and therefore have already been extensively studied. This work provides a theoretical and practical compilation study of some of the security mechanisms included in the current DNIe and in some of the applications that require its use. It has been carried out using only mobile devices and generic card readers, without having any type of privileged access to hardware, software or specific documentation for the interception of packets between the DNIe and the destination application. In other words, it is an exploratory analysis carried out with the intention of confirming with basic tools the level of robustness of this very important security token.


title: Distinct polytropic behavior of plasma during ICME-HSS Interaction

abstract: Interplanetary Coronal Mass Ejections (ICMEs) and High Speed Streams (HSSs) are noteworthy drivers of disturbance of interplanetary space. Interaction between them can cause several phenomena, such as; generation of waves, enhanced geo-effectiveness, particle acceleration, etc. However, how does thermodynamic properties vary during the ICME-HSS interaction remain an open problem. In this study, we investigated the polytropic behavior of plasma during an ICME-HSS interaction observed by STEREO and Wind spacecraft. We find that the ICME observed by the STEREO-A has polytropic index $\alpha = 1.0$, i.e., exhibiting isothermal process. Moreover, Wind spacecraft observed the HSS region, non-interacting ICME, and ICME-HSS interaction region. During each regions we found $\alpha$=1.8, $\alpha$=0.7, and $\alpha$=2.5, respectively. It implies that the HSS region exhibits a nearly adiabatic behaviour, ICME region is closely isothermal, and the ICME-HSS interaction region exhibits super-adiabatic behaviour. The insufficient expansion of the ICME due to the interaction with HSS triggers the system for heating and cooling mechanisms which dependent on the degrees of freedom of plasma components.


title: Drowsiness detection in drivers with a smartwatch

abstract: The main objective of this work is to detect early if a driver shows symptoms of sleepiness that indicate that he/she is falling asleep and, in that case, generate an alert to wake him/her up. To solve this problem, an application has been designed that collects various parameters, through a smartwatch while driving. First, the application detects the driving action. Then, it collects information about the most significant physiological variables of a person while driving. On the other hand, given the high level of sensitivity of the data managed in the designed application, in this work special attention has been paid to the security of the implementation. The proposed solution improves road safety, reducing the number of accidents caused by drowsiness while driving.


title: VP-STO: Via-point-based Stochastic Trajectory Optimization for Reactive Robot Behavior

abstract: Achieving reactive robot behavior in complex dynamic environments is still challenging as it relies on being able to solve trajectory optimization problems quickly enough, such that we can replan the future motion at frequencies which are sufficiently high for the task at hand. We argue that current limitations in Model Predictive Control (MPC) for robot manipulators arise from inefficient, high-dimensional trajectory representations and the negligence of time-optimality in the trajectory optimization process. Therefore, we propose a motion optimization framework that optimizes jointly over space and time, generating smooth and timing-optimal robot trajectories in joint-space. While being task-agnostic, our formulation can incorporate additional task-specific requirements, such as collision avoidance, and yet maintain real-time control rates, demonstrated in simulation and real-world robot experiments on closed-loop manipulation. For additional material, please visit https://sites.google.com/oxfordrobotics.institute/vp-sto.


title: IcebergHT: High Performance PMEM Hash Tables Through Stability and Low Associativity

abstract: Modern hash table designs strive to minimize space while maximizing speed. The most important factor in speed is the number of cache lines accessed during updates and queries. This is especially important on PMEM, which is slower than DRAM and in which writes are more expensive than reads. This paper proposes two stronger design objectives: stability and low-associativity. A stable hash table doesn't move items around, and a hash table has low associativity if there are only a few locations where an item can be stored. Low associativity ensures that queries need to examine only a few memory locations, and stability ensures that insertions write to very few cache lines. Stability also simplifies scaling and crash safety. We present IcebergHT, a fast, crash-safe, concurrent, and space-efficient hash table for PMEM based on the design principles of stability and low associativity. IcebergHT combines in-memory metadata with a new hashing technique, iceberg hashing, that is (1) space efficient, (2) stable, and (3) supports low associativity. In contrast, existing hash-tables either modify numerous cache lines during insertions (e.g. cuckoo hashing), access numerous cache lines during queries (e.g. linear probing), or waste space (e.g. chaining). Moreover, the combination of (1)-(3) yields several emergent benefits: IcebergHT scales better than other hash tables, supports crash-safety, and has excellent performance on PMEM (where writes are particularly expensive).


title: Conformations and dynamics of active star polymers

abstract: We study conformations and dynamics of active star polymers. The analysis shows that active star polymers stretching behaviour is quite different from that of active linear chains. The visual inspection of conformations and bond-bond correlations reveal a better coordination for the alignment and coordination of bonds for the star polymers than for the linear counterparts. The architecture substantially affects the chain extension transition at high values of active force. The scaling laws for the shape factor and the arm asphericity ratio established for the passive star polymers coincide with the passive case for active force values below the transition. For the values above the transition range the scaling of these quantities switches to different values.


title: Generalized Alder-Type Partition Inequalities

abstract: In 2020, Kang and Park conjectured a "level $2$" Alder-type partition inequality which encompasses the second Rogers-Ramanujan Identity. Duncan, Khunger, the fourth author, and Tamura proved Kang and Park's conjecture for all but finitely many cases utilizing a "shift" inequality and conjectured a further, weaker generalization that would extend both Alder's (now proven) as well as Kang and Park's conjecture to general level. Utilizing a modified shift inequality, Inagaki and Tamura have recently proven that the Kang and Park conjecture holds for level $3$ in all but finitely many cases. They further conjectured a stronger shift inequality which would imply a general level result for all but finitely many cases. Here, we prove their conjecture for large enough $n$, generalize the result for an arbitrary shift, and discuss the implications for Alder-type partition inequalities.


title: Big Bang nucleosynthesis as a probe of new physics

abstract: The Big Bang Nucleosynthesis (BBN) model is a cornerstone for the understanding of the evolution of the early universe, making seminal predictions that are in outstanding agreement with the present observation of light element abundances in the universe. Perhaps, the only remaining issue to be solved by theory is the so-called "lithium abundance problem". Dedicated experimental efforts to measure the relevant nuclear cross sections used as input of the model have lead to an increased level of accuracy in the prediction of the light element primordial abundances. The rise of indirect experimental techniques during the preceding few decades has permitted the access of reaction information beyond the limitations of direct measurements. New theoretical developments have also opened a fertile ground for tests of physics beyond the standard model of atomic, nuclear, statistics, and particle physics. We review the latest contributions of our group for possible solutions of the lithium problem.


title: Flow-based GAN for 3D Point Cloud Generation from a Single Image

abstract: Generating a 3D point cloud from a single 2D image is of great importance for 3D scene understanding applications. To reconstruct the whole 3D shape of the object shown in the image, the existing deep learning based approaches use either explicit or implicit generative modeling of point clouds, which, however, suffer from limited quality. In this work, we aim to alleviate this issue by introducing a hybrid explicit-implicit generative modeling scheme, which inherits the flow-based explicit generative models for sampling point clouds with arbitrary resolutions while improving the detailed 3D structures of point clouds by leveraging the implicit generative adversarial networks (GANs). We evaluate on the large-scale synthetic dataset ShapeNet, with the experimental results demonstrating the superior performance of the proposed method. In addition, the generalization ability of our method is demonstrated by performing on cross-category synthetic images as well as by testing on real images from PASCAL3D+ dataset.


title: On Task-Adaptive Pretraining for Dialogue Response Selection

abstract: Recent advancements in dialogue response selection (DRS) are based on the \textit{task-adaptive pre-training (TAP)} approach, by first initializing their model with BERT~\cite{devlin-etal-2019-bert}, and adapt to dialogue data with dialogue-specific or fine-grained pre-training tasks. However, it is uncertain whether BERT is the best initialization choice, or whether the proposed dialogue-specific fine-grained learning tasks are actually better than MLM+NSP. This paper aims to verify assumptions made in previous works and understand the source of improvements for DRS. We show that initializing with RoBERTa achieve similar performance as BERT, and MLM+NSP can outperform all previously proposed TAP tasks, during which we also contribute a new state-of-the-art on the Ubuntu corpus. Additional analyses shows that the main source of improvements comes from the TAP step, and that the NSP task is crucial to DRS, different from common NLU tasks.


title: Are All Steps Equally Important? Benchmarking Essentiality Detection of Events

abstract: Natural language expresses events with varying granularities, where coarse-grained events (goals) can be broken down into finer-grained event sequences (steps). A critical yet overlooked aspect of understanding event processes is recognizing that not all step events hold equal importance toward the completion of a goal. In this paper, we address this gap by examining the extent to which current models comprehend the essentiality of step events in relation to a goal event. Cognitive studies suggest that such capability enables machines to emulate human commonsense reasoning about preconditions and necessary efforts of everyday tasks. We contribute a high-quality corpus of (goal, step) pairs gathered from the community guideline website WikiHow, with steps manually annotated for their essentiality concerning the goal by experts. The high inter-annotator agreement demonstrates that humans possess a consistent understanding of event essentiality. However, after evaluating multiple statistical and largescale pre-trained language models, we find that existing approaches considerably underperform compared to humans. This observation highlights the need for further exploration into this critical and challenging task. The dataset and code are available at http://cogcomp.org/page/publication_view/1023.


title: Weak amenability of weighted measure algebras and their second duals

abstract: In this paper, we study the weak amenability of weighted measure algebras and prove that $M(G, \omega)$ is weakly amenable if and only if $G$ is discrete and every bounded quasi-additive function is inner. We also study the weak amenability of $L^1(G, \omega)^{**}$ and $M(G, \omega)^{**}$ and show that the weak amenability of theses Banach algebras are equivalent to finiteness of $G$. This gives an answer to the question concerning weak amenability of $L^1(G, \omega)^{**}$ and $M(G, \omega)^{**}$.


title: Robustness of Unsupervised Representation Learning without Labels

abstract: Unsupervised representation learning leverages large unlabeled datasets and is competitive with supervised learning. But non-robust encoders may affect downstream task robustness. Recently, robust representation encoders have become of interest. Still, all prior work evaluates robustness using a downstream classification task. Instead, we propose a family of unsupervised robustness measures, which are model- and task-agnostic and label-free. We benchmark state-of-the-art representation encoders and show that none dominates the rest. We offer unsupervised extensions to the FGSM and PGD attacks. When used in adversarial training, they improve most unsupervised robustness measures, including certified robustness. We validate our results against a linear probe and show that, for MOCOv2, adversarial training results in 3 times higher certified accuracy, a 2-fold decrease in impersonation attack success rate and considerable improvements in certified robustness.


title: Linear Inverse Problems with Hessian-Schatten Total Variation

abstract: In this paper, we characterize the class of extremal points of the unit ball of the Hessian-Schatten total variation (HTV) functional. The underlying motivation for our work stems from a general representer theorem that characterizes the solution set of regularized linear inverse problems in terms of the extremal points of the regularization ball. Our analysis is mainly based on studying the class of continuous and piecewise linear (CPWL) functions. In particular, we show that in dimension $d=2$, CPWL functions are dense in the unit ball of the HTV functional. Moreover, we prove that a CPWL function is extremal if and only if its Hessian is minimally supported. For the converse, we prove that the density result (which we have only proven for dimension $d = 2$) implies that the closure of the CPWL extreme points contains all extremal points.


title: Energy transition density of driven chaotic systems: A compound trace formula

abstract: Oscillations in the probability density of quantum transitions of the eigenstates of a chaotic Hamiltonian within classically narrow energy ranges have been shown to depend on closed compound orbits. These are formed by a pair of orbit segments, one in the energy shell of the original Hamiltonian and the other in the energy shell of the driven Hamiltonian, with endpoints which coincide. Viewed in the time domain, the same pair of trajectory segments arises in the semiclassical evaluation of the trace of a compound propagator: the product of the complex exponentials of the original Hamiltonian and of its driven image. It is shown here that the probability density is the double Fourier transform of this trace, so that the closed compound orbits emulate the role played by periodic orbits in Gutzwiller's trace formula in its semiclassical evaluation. The phase of the oscillations with the energies or evolution parameters agree with those previously obtained, whereas the amplitude of the contribution of each closed compound orbit is more compact and independent of any feature of the Weyl-Wigner representation in which the calculation was carried out.


title: Unweighted estimation based on optimal sample under measurement constraints

abstract: To tackle massive data, subsampling is a practical approach to select the more informative data points. However, when responses are expensive to measure, developing efficient subsampling schemes is challenging, and an optimal sampling approach under measurement constraints was developed to meet this challenge. This method uses the inverses of optimal sampling probabilities to reweight the objective function, which assigns smaller weights to the more important data points. Thus the estimation efficiency of the resulting estimator can be improved. In this paper, we propose an unweighted estimating procedure based on optimal subsamples to obtain a more efficient estimator. We obtain the unconditional asymptotic distribution of the estimator via martingale techniques without conditioning on the pilot estimate, which has been less investigated in the existing subsampling literature. Both asymptotic results and numerical results show that the unweighted estimator is more efficient in parameter estimation.


title: Delivery to Safety with Two Cooperating Robots

abstract: Two cooperating, autonomous mobile robots with arbitrary nonzero max speeds are placed at arbitrary initial positions in the plane. A remotely detonated bomb is discovered at some source location and must be moved to a safe distance away from its initial location as quickly as possible. In the Bomb Squad problem, the robots cooperate by communicating face-to-face in order to pick up the bomb from the source and carry it away to the boundary of a disk centered at the source in the shortest possible time. The goal is to specify trajectories which define the robots' paths from start to finish and their meeting points which enable face-to-face collaboration by exchanging information and passing the bomb from robot to robot. We design algorithms reflecting the robots' knowledge about orientation and each other's speed and location. In the offline case, we design an optimal algorithm. For the limited knowledge cases, we provide online algorithms which consider robots' level of agreement on orientation as per OneAxis and NoAxis models, and knowledge of the boundary as per Visible, Discoverable, and Invisible. In all cases, we provide upper and lower bounds for the competitive ratios of the online problems.


title: Less is More: SlimG for Accurate, Robust, and Interpretable Graph Mining

abstract: How can we solve semi-supervised node classification in various graphs possibly with noisy features and structures? Graph neural networks (GNNs) have succeeded in many graph mining tasks, but their generalizability to various graph scenarios is limited due to the difficulty of training, hyperparameter tuning, and the selection of a model itself. Einstein said that we should "make everything as simple as possible, but not simpler." We rephrase it into the careful simplicity principle: a carefully-designed simple model can surpass sophisticated ones in real-world graphs. Based on the principle, we propose SlimG for semi-supervised node classification, which exhibits four desirable properties: It is (a) accurate, winning or tying on 10 out of 13 real-world datasets; (b) robust, being the only one that handles all scenarios of graph data (homophily, heterophily, random structure, noisy features, etc.); (c) fast and scalable, showing up to 18 times faster training in million-scale graphs; and (d) interpretable, thanks to the linearity and sparsity. We explain the success of SlimG through a systematic study of the designs of existing GNNs, sanity checks, and comprehensive ablation studies.


title: Quantum electrodynamics of chiral waveguide arrays

abstract: We consider the quantum electrodynamics of a binary array of chiral waveguides, each containing many atoms. We show that the one-photon amplitude of a single-excitation state obeys a two-dimensional Dirac equation. Using this result, we develop the scattering theory for the Dirac equation in this setting and illustrate our results with numerical simulations.


title: Unified Probabilistic Neural Architecture and Weight Ensembling Improves Model Robustness

abstract: Robust machine learning models with accurately calibrated uncertainties are crucial for safety-critical applications. Probabilistic machine learning and especially the Bayesian formalism provide a systematic framework to incorporate robustness through the distributional estimates and reason about uncertainty. Recent works have shown that approximate inference approaches that take the weight space uncertainty of neural networks to generate ensemble prediction are the state-of-the-art. However, architecture choices have mostly been ad hoc, which essentially ignores the epistemic uncertainty from the architecture space. To this end, we propose a Unified probabilistic architecture and weight ensembling Neural Architecture Search (UraeNAS) that leverages advances in probabilistic neural architecture search and approximate Bayesian inference to generate ensembles form the joint distribution of neural network architectures and weights. The proposed approach showed a significant improvement both with in-distribution (0.86% in accuracy, 42% in ECE) CIFAR-10 and out-of-distribution (2.43% in accuracy, 30% in ECE) CIFAR-10-C compared to the baseline deterministic approach.


title: SpyHammer: Understanding and Exploiting RowHammer under Fine-Grained Temperature Variations

abstract: RowHammer is a DRAM vulnerability that can cause bit errors in a victim DRAM row solely by accessing its neighboring DRAM rows at a high-enough rate. Recent studies demonstrate that new DRAM devices are becoming increasingly vulnerable to RowHammer, and many works demonstrate system-level attacks for privilege escalation or information leakage. In this work, we perform the first rigorous fine-grained characterization and analysis of the correlation between RowHammer and temperature. We show that RowHammer is very sensitive to temperature variations, even if the variations are very small (e.g., $\pm 1$ {\deg}C). We leverage two key observations from our analysis to spy on DRAM temperature: 1) RowHammer-induced bit error rate consistently increases (or decreases) as the temperature increases, and 2) some DRAM cells that are vulnerable to RowHammer exhibit bit errors only at a particular temperature. Based on these observations, we propose a new RowHammer attack, called SpyHammer, that spies on the temperature of DRAM on critical systems such as industrial production lines, vehicles, and medical systems. SpyHammer is the first practical attack that can spy on DRAM temperature. Our evaluation in a controlled environment shows that SpyHammer can infer the temperature of the victim DRAM modules with an error of less than $\pm 2.5$ {\deg}C at the 90th percentile of all tested temperatures, for 12 real DRAM modules (120 DRAM chips) from four main manufacturers.


title: Dual Pyramid Generative Adversarial Networks for Semantic Image Synthesis

abstract: The goal of semantic image synthesis is to generate photo-realistic images from semantic label maps. It is highly relevant for tasks like content generation and image editing. Current state-of-the-art approaches, however, still struggle to generate realistic objects in images at various scales. In particular, small objects tend to fade away and large objects are often generated as collages of patches. In order to address this issue, we propose a Dual Pyramid Generative Adversarial Network (DP-GAN) that learns the conditioning of spatially-adaptive normalization blocks at all scales jointly, such that scale information is bi-directionally used, and it unifies supervision at different scales. Our qualitative and quantitative results show that the proposed approach generates images where small and large objects look more realistic compared to images generated by state-of-the-art methods.


title: A Structural Equation Modeling Approach to Understand User's Perceptions of Acceptance of Ride-Sharing Services in Dhaka City

abstract: This research aims at building a multivariate statistical model for assessing users' perceptions of acceptance of ride-sharing services in Dhaka City. A structured questionnaire is developed based on the users' reported attitudes and perceived risks. A total of 350 normally distributed responses are collected from ride-sharing service users and stakeholders of Dhaka City. Respondents are interviewed to express their experience and opinions on ride-sharing services through the stated preference questionnaire. Structural Equation Modeling (SEM) is used to validate the research hypotheses. Statistical parameters and several trials are used to choose the best SEM. The responses are also analyzed using the Relative Importance Index (RII) method, validating the chosen SEM. Inside SEM, the quality of ride-sharing services is measured by two latent and eighteen observed variables. The latent variable 'safety & security' is more influential than 'service performance' on the overall quality of service index. Under 'safety & security' the other two variables, i.e., 'account information' and 'personal information' are found to be the most significant that impact the decision to share rides with others. In addition, 'risk of conflict' and 'possibility of accident' are identified using the perception model as the lowest contributing variables. Factor analysis reveals the suitability and reliability of the proposed SEM. Identifying the influential parameters in this will help the service providers understand and improve the quality of ride-sharing service for users.


title: Symmetry Defense Against CNN Adversarial Perturbation Attacks

abstract: This paper uses symmetry to make Convolutional Neural Network classifiers (CNNs) robust against adversarial perturbation attacks. Such attacks add perturbation to original images to generate adversarial images that fool classifiers such as road sign classifiers of autonomous vehicles. Although symmetry is a pervasive aspect of the natural world, CNNs are unable to handle symmetry well. For example, a CNN can classify an image differently from its mirror image. For an adversarial image that misclassifies with a wrong label $l_w$, CNN inability to handle symmetry means that a symmetric adversarial image can classify differently from the wrong label $l_w$. Further than that, we find that the classification of a symmetric adversarial image reverts to the correct label. To classify an image when adversaries are unaware of the defense, we apply symmetry to the image and use the classification label of the symmetric image. To classify an image when adversaries are aware of the defense, we use mirror symmetry and pixel inversion symmetry to form a symmetry group. We apply all the group symmetries to the image and decide on the output label based on the agreement of any two of the classification labels of the symmetry images. Adaptive attacks fail because they need to rely on loss functions that use conflicting CNN output values for symmetric images. Without attack knowledge, the proposed symmetry defense succeeds against both gradient-based and random-search attacks, with up to near-default accuracies for ImageNet. The defense even improves the classification accuracy of original images.


title: Collaborative Domain Blocking: Using federated NLP To Detect Malicious Domains

abstract: Current content filtering and blocking methods are susceptible to various circumvention techniques and are relatively slow in dealing with new threats. This is due to these methods using shallow pattern recognition that is based on regular expression rules found in crowdsourced block lists. We propose a novel system that aims to remedy the aforementioned issues by examining deep textual patterns of network-oriented content relating to the domain being interacted with. Moreover, we propose to use federated learning that allows users to take advantage of each other's localized knowledge/experience regarding what should or should not be blocked on a network without compromising privacy. Our experiments show the promise of our proposed approach in real world settings. We also provide data-driven recommendations on how to best implement the proposed system.


title: [Dissertation] Fundamental Limits to Single-Photon Detection

abstract: Quantum mechanics cements the intimate relationship between the nature of light and its detection. Historically, quantum theories of photodetection have generally fallen into two categories: the first tries to determine what quantum field observable is measured when photoelectrons are detected, laying the theoretical groundwork for photodetection being possible. The second type are phenomenological theories, which take great care to model the details of specific photodetectors. In this dissertation, we fill in the gap between these two models in the modern literature on photodetection by constructing a fully quantum mechanical and sufficiently realistic model that includes all stages of the photodetection process: transmission, amplification, and a final classical measurement. We accomplish this within the framework of quantum information theory using the language of positive operator valued measures (POVMs). This dissertation contains material previously published in three papers: Propp, Tz. B & van Enk, S. J. (2019). On nonlinear amplification: improved quantum limits for photon counting. Optics Express 27, 16, 23454-23463. Propp, Tz. B & van Enk, S. J. (2019). Quantum networks for single photon detection. Physical Review A, 100, 033836. Propp, Tz. B & van Enk, S. J. (2020). How to project onto an arbitrary single-photon wavepacket. Physical Review A, 102, 053707.


title: APUD(1,1) Recognition in Polynomial Time

abstract: A unit disk graph is the intersection graph of a set of disk of unit radius in the Euclidean plane. In 1998, Breu and Kirkpatrick showed that the recognition problem for unit disk graphs is NP-hard. Given $k$ horizontal and $m$ vertical lines, an APUD($k,m$) is a unit disk graph such that each unit disk is centered either on a given horizontal or vertical line. \c{C}a\u{g}{\i}r{\i}c{\i} showed in 2020 that APUD($k,m$) recognition is NP-hard. In this paper, we show that APUD($1,1$) recognition is polynomial time solvable.


title: A Zero-Sum Game Framework for Optimal Sensor Placement in Uncertain Networked Control Systems under Cyber-Attacks

abstract: This paper proposes a game-theoretic approach to address the problem of optimal sensor placement against an adversary in uncertain networked control systems. The problem is formulated as a zero-sum game with two players, namely a malicious adversary and a detector. Given a protected performance vertex, we consider a detector, with uncertain system knowledge, that selects another vertex on which to place a sensor and monitors its output with the aim of detecting the presence of the adversary. On the other hand, the adversary, also with uncertain system knowledge, chooses a single vertex and conducts a cyber-attack on its input. The purpose of the adversary is to drive the attack vertex as to maximally disrupt the protected performance vertex while remaining undetected by the detector. As our first contribution, the game payoff of the above-defined zero-sum game is formulated in terms of the Value-at-Risk of the adversary's impact. However, this game payoff corresponds to an intractable optimization problem. To tackle the problem, we adopt the scenario approach to approximately compute the game payoff. Then, the optimal monitor selection is determined by analyzing the equilibrium of the zero-sum game. The proposed approach is illustrated via a numerical example of a 10-vertex networked control system.


title: Advancing Model Pruning via Bi-level Optimization

abstract: The deployment constraints in practical applications necessitate the pruning of large-scale deep learning models, i.e., promoting their weight sparsity. As illustrated by the Lottery Ticket Hypothesis (LTH), pruning also has the potential of improving their generalization ability. At the core of LTH, iterative magnitude pruning (IMP) is the predominant pruning method to successfully find 'winning tickets'. Yet, the computation cost of IMP grows prohibitively as the targeted pruning ratio increases. To reduce the computation overhead, various efficient 'one-shot' pruning methods have been developed, but these schemes are usually unable to find winning tickets as good as IMP. This raises the question of how to close the gap between pruning accuracy and pruning efficiency? To tackle it, we pursue the algorithmic advancement of model pruning. Specifically, we formulate the pruning problem from a fresh and novel viewpoint, bi-level optimization (BLO). We show that the BLO interpretation provides a technically-grounded optimization base for an efficient implementation of the pruning-retraining learning paradigm used in IMP. We also show that the proposed bi-level optimization-oriented pruning method (termed BiP) is a special class of BLO problems with a bi-linear problem structure. By leveraging such bi-linearity, we theoretically show that BiP can be solved as easily as first-order optimization, thus inheriting the computation efficiency. Through extensive experiments on both structured and unstructured pruning with 5 model architectures and 4 data sets, we demonstrate that BiP can find better winning tickets than IMP in most cases, and is computationally as efficient as the one-shot pruning schemes, demonstrating 2-7 times speedup over IMP for the same level of model accuracy and sparsity.


title: Dynamical quantum phase transitions in SYK Lindbladians

abstract: We study the open quantum dynamics of the Sachdev-Ye-Kitaev (SYK) model described by the Lindblad master equation, where the SYK model is coupled to Markovian reservoirs with jump operators that are either linear or quadratic in the Majorana fermion operators. Of particular interest for us is the time evolution of the dissipative form factor, which quantifies the average overlap between the initial and time-evolved density matrices as an open quantum generalization of the Loschmidt echo. We find that the dissipative form factor exhibits dynamical quantum phase transitions. We analytically demonstrate a discontinuous dynamical phase transition in the limit of large number of fermion flavors, which is formally akin to the thermal phase transition in the two-coupled SYK model between the black-hole and wormhole phases. We also find continuous dynamical phase transitions that do not have counterparts in the two-coupled SYK model. While the phase transitions are sharp in the limit of large number of fermion flavors, their qualitative signatures are present even for the finite number of fermion flavors, as we show numerically.


title: Dual-Mode Time Domain Multiplexed Chirp Spread Spectrum

abstract: We propose a dual-mode (DM) time domain multiplexed (TDM) chirp spread spectrum (CSS) modulation for spectral and energy-efficient low-power wide-area networks (LPWANs). DM-CSS modulation that uses both the even and odd cyclic time shifts has been proposed for LPWANs to achieve noteworthy performance improvement over classical counterparts. However, its spectral efficiency (SE) is half of the in-phase and quadrature (IQ)-TDM-CSS scheme that employs IQ components with both up and down chirps, resulting in a SE that is four times relative to Long Range (LoRa) modulation. Nevertheless, the IQ-TDM-CSS scheme only allows coherent detection. Furthermore, it is also sensitive to carrier frequency and phase offsets, making it less practical for low-cost battery-powered LPWANs for Internet-of-Things (IoT) applications. DM-CSS uses either an up-chirp or a down-chirp. DM-TDM-CSS consists of two chirped symbols that are multiplexed in the time domain. One of these symbols consisting of even and odd frequency shifts (FSs) is chirped using an up-chirp. The second chirped symbol also consists of even and odd FSs, but they are chirped using a down-chirp. It shall be demonstrated that DM-TDM-CSS attains a maximum achievable SE close to IQ-TDM-CSS while also allowing both coherent and non-coherent detection. Additionally, unlike IQ-TDM-CSS, DM-TDM-CSS is robust against carrier frequency and phase offsets.


title: How do you go where? Improving next location prediction by learning travel mode information using transformers

abstract: Predicting the next visited location of an individual is a key problem in human mobility analysis, as it is required for the personalization and optimization of sustainable transport options. Here, we propose a transformer decoder-based neural network to predict the next location an individual will visit based on historical locations, time, and travel modes, which are behaviour dimensions often overlooked in previous work. In particular, the prediction of the next travel mode is designed as an auxiliary task to help guide the network's learning. For evaluation, we apply this approach to two large-scale and long-term GPS tracking datasets involving more than 600 individuals. Our experiments show that the proposed method significantly outperforms other state-of-the-art next location prediction methods by a large margin (8.05% and 5.60% relative increase in F1-score for the two datasets, respectively). We conduct an extensive ablation study that quantifies the influence of considering temporal features, travel mode information, and the auxiliary task on the prediction results. Moreover, we experimentally determine the performance upper bound when including the next mode prediction in our model. Finally, our analysis indicates that the performance of location prediction varies significantly with the chosen next travel mode by the individual. These results show potential for a more systematic consideration of additional dimensions of travel behaviour in human mobility prediction tasks. The source code of our model and experiments is available at https://github.com/mie-lab/location-mode-prediction.


title: PropertyDAG: Multi-objective Bayesian optimization of partially ordered, mixed-variable properties for biological sequence design

abstract: Bayesian optimization offers a sample-efficient framework for navigating the exploration-exploitation trade-off in the vast design space of biological sequences. Whereas it is possible to optimize the various properties of interest jointly using a multi-objective acquisition function, such as the expected hypervolume improvement (EHVI), this approach does not account for objectives with a hierarchical dependency structure. We consider a common use case where some regions of the Pareto frontier are prioritized over others according to a specified $\textit{partial ordering}$ in the objectives. For instance, when designing antibodies, we would like to maximize the binding affinity to a target antigen only if it can be expressed in live cell culture -- modeling the experimental dependency in which affinity can only be measured for antibodies that can be expressed and thus produced in viable quantities. In general, we may want to confer a partial ordering to the properties such that each property is optimized conditioned on its parent properties satisfying some feasibility condition. To this end, we present PropertyDAG, a framework that operates on top of the traditional multi-objective BO to impose this desired ordering on the objectives, e.g. expression $\rightarrow$ affinity. We demonstrate its performance over multiple simulated active learning iterations on a penicillin production task, toy numerical problem, and a real-world antibody design task.


title: Analysis of long transients and detection of early warning signals of extinction in a class of predator-prey models exhibiting bistable behavior

abstract: In this paper, we develop a method of analyzing long transient dynamics in a class of predator-prey models with two species of predators competing explicitly for their common prey, where the prey evolves on a faster timescale than the predators. In a parameter regime near a {\em{singular zero-Hopf bifurcation}} of the coexistence equilibrium state, we assume that the system under study exhibits bistability between a periodic attractor that bifurcates from the singular Hopf point and another attractor, which could be a periodic attractor or a point attractor, such that the invariant manifolds of the coexistence equilibrium point play central roles in organizing the dynamics. To find whether a solution that starts in a vicinity of the coexistence equilibrium approaches the periodic attractor or the other attractor, we reduce the equations to a suitable normal form, and examine the basin boundary near the singular Hopf point. A key component of our study includes an analysis of the long transient dynamics, characterized by their rapid oscillations with a slow variation in amplitude, by applying a moving average technique. We obtain a set of necessary and sufficient conditions on the initial values of a solution near the coexistence equilibrium to determine whether it lies in the basin of attraction of the periodic attractor. As a result of our analysis, we devise a method of identifying early warning signals, significantly in advance, of a future crisis that could lead to extinction of one of the predators. The analysis is applied to the predator-prey model considered in [\emph{Discrete and Continuous Dynamical Systems - B} 2021, 26(10), pp. 5251-5279] and we find that our theory is in good agreement with the numerical simulations carried out for this model.


title: Controlling a Markov Decision Process with an Abrupt Change in the Transition Kernel

abstract: We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a mode-observing controller, as an optimal stopping problem. Using a sequence of approximations, we reduce it to a quickest change detection (QCD) problem with Markovian data, for which we characterize a state-dependent threshold-type optimal change detection policy. Numerical experiments illustrate various properties of our control-switching policy.


title: Developable Quad Meshes and Contact Element Nets

abstract: The property of a surface being developable can be expressed in different equivalent ways, by vanishing Gauss curvature, or by the existence of isometric mappings to planar domains. Computational contributions to this topic range from special parametrizations to discrete-isometric mappings. However, so far a local criterion expressing developability of general quad meshes has been lacking. In this paper, we propose a new and efficient discrete developability criterion that is applied to quad meshes equipped with vertex weights, and which is motivated by a well-known characterization in differential geometry, namely a rank-deficient second fundamental form. We assign contact elements to the faces of meshes and ruling vectors to the edges, which in combination yield a developability condition per face. Using standard optimization procedures, we are able to perform interactive design and developable lofting. The meshes we employ are combinatorial regular quad meshes with isolated singularities but are otherwise not required to follow any special curves on a developable surface. They are thus easily embedded into a design workflow involving standard operations like remeshing, trimming, and merging operations. An important feature is that we can directly derive a watertight, rational bi-quadratic spline surface from our meshes. Remarkably, it occurs as the limit of weighted Doo-Sabin subdivision, which acts in an interpolatory manner on contact elements.


title: Doubly robust estimation and sensitivity analysis for marginal structural quantile models

abstract: The marginal structure quantile model (MSQM) provides a unique lens to understand the causal effect of a time-varying treatment on the full distribution of potential outcomes. Under the semiparametric framework, we derive the efficiency influence function for the MSQM, from which a new doubly robust estimator is proposed for point estimation and inference. We show that the doubly robust estimator is consistent if either of the models associated with treatment assignment or the potential outcome distributions is correctly specified, and is semiparametric efficient if both models are correct. To implement the doubly robust MSQM estimator, we propose to solve a smoothed estimating equation to facilitate efficient computation of the point and variance estimates. In addition, we develop a confounding function approach to investigate the sensitivity of several MSQM estimators when the sequential ignorability assumption is violated. Extensive simulations are conducted to examine the finite-sample performance characteristics of the proposed methods. We apply the proposed methods to the Yale New Haven Health System Electronic Health Record data to study the effect of antihypertensive medications to patients with severe hypertension and assess the robustness of findings to unmeasured baseline and time-varying confounding.


title: Non-relativistic gravity theories in four spacetime dimensions

abstract: In this work we present a non-relativistic gravity theory defined in four spacetime dimensions using the MacDowell-Mansouri geometrical formulation. We obtain a Newtonian gravity action which is constructed from the curvature of a Newton-Hooke version of the so-called Newtonian algebra. We show that the non-relativistic gravity theory presented here contains the Poisson equation in presence of a cosmological constant. Moreover we make contact with the Modified Newtonian Dynamics (MOND) approach for gravity by considering a particular ansatz for a given gauge field. We extend our results to a generalized non-relativistic MacDowell-Mansouri gravity theory by considering a generalized Newton-Hooke algebra.


title: Innovation with and without patents

abstract: A long-standing discussion is to what extent patents can be used to monitor trends in innovation activity. This study quantifies the amount and quality of information about actual innovation contained in the patent system, based on 4,460 Swedish innovations (1970-2015) that have been matched to international patents. The results show that most innovations were not patented and that among those that were, 43.9% of all innovations, only a fraction can be identified with patent quality data. The best-performing models identify 17% of all information about innovations, equivalent to an information loss of at least 83%. Econometric tests also show that the fraction of innovations responding to strengthened patent laws during the period were on average 8% percent. The overlap between the patent and innovation systems is hence more modest than often assumed. This accentuates the need to, alongside patents, develop versatile approaches in order to induce and monitor various aspects of innovation.


title: Controversy-seeking fuels rumor-telling activity in polarized opinion networks

abstract: Rumors have ignited revolutions, undermined the trust in political parties, or threatened the stability of human societies. Such destructive potential has been significantly enhanced by the development of on-line social networks. Several theoretical and computational studies have been devoted to understanding the dynamics and to control rumor spreading. In the present work, a model of rumor-telling in opinion polarized networks was investigated through extensive computer simulations. The key mechanism is the coupling between ones' opinions and their leaning to spread a given information, either by supporting or opposing its content. We report that a highly modular topology of polarized networks strongly impairs rumor spreading, but the couplings between agent's opinions and their spreading/stifling rates can either further inhibit or, conversely, foster information propagation, depending on the nature of those couplings. In particular, a controversy-seeking mechanism, in which agents are stimulated to postpone their transitions to the stiffer state upon interactions with other agents of confronting opinions, enhances the rumor spreading. Therefore such a mechanism is capable of overcoming the propagation bottlenecks imposed by loosely connected modular structures.


title: Training Deep Learning Algorithms on Synthetic Forest Images for Tree Detection

abstract: Vision-based segmentation in forested environments is a key functionality for autonomous forestry operations such as tree felling and forwarding. Deep learning algorithms demonstrate promising results to perform visual tasks such as object detection. However, the supervised learning process of these algorithms requires annotations from a large diversity of images. In this work, we propose to use simulated forest environments to automatically generate 43 k realistic synthetic images with pixel-level annotations, and use it to train deep learning algorithms for tree detection. This allows us to address the following questions: i) what kind of performance should we expect from deep learning in harsh synthetic forest environments, ii) which annotations are the most important for training, and iii) what modality should be used between RGB and depth. We also report the promising transfer learning capability of features learned on our synthetic dataset by directly predicting bounding box, segmentation masks and keypoints on real images. Code available on GitHub (https://github.com/norlab-ulaval/PercepTreeV1).


title: KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding

abstract: With the advent of pretrained language models (LMs), increasing research efforts have been focusing on infusing commonsense and domain-specific knowledge to prepare LMs for downstream tasks. These works attempt to leverage knowledge graphs, the de facto standard of symbolic knowledge representation, along with pretrained LMs. While existing approaches have leveraged external knowledge, it remains an open question how to jointly incorporate knowledge graphs representing varying contexts, from local (e.g., sentence), to document-level, to global knowledge, to enable knowledge-rich exchange across these contexts. Such rich contextualization can be especially beneficial for long document understanding tasks since standard pretrained LMs are typically bounded by the input sequence length. In light of these challenges, we propose KALM, a Knowledge-Aware Language Model that jointly leverages knowledge in local, document-level, and global contexts for long document understanding. KALM first encodes long documents and knowledge graphs into the three knowledge-aware context representations. It then processes each context with context-specific layers, followed by a context fusion layer that facilitates knowledge exchange to derive an overarching document representation. Extensive experiments demonstrate that KALM achieves state-of-the-art performance on six long document understanding tasks and datasets. Further analyses reveal that the three knowledge-aware contexts are complementary and they all contribute to model performance, while the importance and information exchange patterns of different contexts vary with respect to different tasks and datasets.


title: The effect of variable labels on deep learning models trained to predict breast density

abstract: Purpose: High breast density is associated with reduced efficacy of mammographic screening and increased risk of developing breast cancer. Accurate and reliable automated density estimates can be used for direct risk prediction and passing density related information to further predictive models. Expert reader assessments of density show a strong relationship to cancer risk but also inter-reader variation. The effect of label variability on model performance is important when considering how to utilise automated methods for both research and clinical purposes. Methods: We utilise subsets of images with density labels to train a deep transfer learning model which is used to assess how label variability affects the mapping from representation to prediction. We then create two end-to-end deep learning models which allow us to investigate the effect of label variability on the model representation formed. Results: We show that the trained mappings from representations to labels are altered considerably by the variability of reader scores. Training on labels with distribution variation removed causes the Spearman rank correlation coefficients to rise from $0.751\pm0.002$ to either $0.815\pm0.006$ when averaging across readers or $0.844\pm0.002$ when averaging across images. However, when we train different models to investigate the representation effect we see little difference, with Spearman rank correlation coefficients of $0.846\pm0.006$ and $0.850\pm0.006$ showing no statistically significant difference in the quality of the model representation with regard to density prediction. Conclusions: We show that the mapping between representation and mammographic density prediction is significantly affected by label variability. However, the effect of the label variability on the model representation is limited.


title: Comparing Computational Architectures for Automated Journalism

abstract: The majority of NLG systems have been designed following either a template-based or a pipeline-based architecture. Recent neural models for data-to-text generation have been proposed with an end-to-end deep learning flavor, which handles non-linguistic input in natural language without explicit intermediary representations. This study compares the most often employed methods for generating Brazilian Portuguese texts from structured data. Results suggest that explicit intermediate steps in the generation process produce better texts than the ones generated by neural end-to-end architectures, avoiding data hallucination while better generalizing to unseen inputs. Code and corpus are publicly available.


title: Visual Looming from Motion Field and Surface Normals

abstract: Looming, traditionally defined as the relative expansion of objects in the observer's retina, is a fundamental visual cue for perception of threat and can be used to accomplish collision free navigation. In this paper we derive novel solutions for obtaining visual looming quantitatively from the 2D motion field resulting from a six-degree-of-freedom motion of an observer relative to a local surface in 3D. We also show the relationship between visual looming and surface normals. We present novel methods to estimate visual looming from spatial derivatives of optical flow without the need for knowing range. Simulation results show that estimations of looming are very close to ground truth looming under some assumptions of surface orientations. In addition, we present results of visual looming using real data from the KITTI dataset. Advantages and limitations of the methods are discussed as well.


title: Graphs with equal girth and circumference

abstract: We characterise the form of all simple, finite graphs for which the girth of the graph is equal to the circumference of the graph. We apply this to prove a bound on the number of edges in such a graph.


title: Optimization frameworks and sensitivity analysis of Stackelberg mean-field games

abstract: This paper proposes and studies a class of discrete-time finite-time-horizon Stackelberg mean-field games, with one leader and an infinite number of identical and indistinguishable followers. In this game, the objective of the leader is to maximize her reward considering the worst-case cost over all possible $\epsilon$-Nash equilibria among followers. A new analytical paradigm is established by showing the equivalence between this Stackelberg mean-field game and a minimax optimization problem. This optimization framework facilitates studying both analytically and numerically the set of Nash equilibria for the game; and leads to the sensitivity and the robustness analysis of the game value. In particular, when there is model uncertainty, the game value for the leader suffers non-vanishing sub-optimality as the perturbed model converges to the true model. In order to obtain a near-optimal solution, the leader needs to be more pessimistic with anticipation of model errors and adopts a relaxed version of the original Stackelberg game.


title: Corticosteroid Activation of Atlantic Sea Lamprey Corticoid Receptor: Allosteric Regulation by the N-terminal Domain

abstract: Lampreys are jawless fish that evolved about 550 million years ago at the base of the vertebrate line. Modern lampreys contain a corticoid receptor (CR), the common ancestor of the glucocorticoid receptor (GR) and mineralocorticoid receptor (MR), which first appear in cartilaginous fish, such as sharks. Until recently, 344 amino acids at the amino terminus of adult lamprey CR were not present in the lamprey CR sequence in GenBank. A search of the recently sequenced lamprey germline genome identified two CR sequences, CR1 and CR2, containing the 344 previously un-identified amino acids at the amino terminus. CR1 also contains a novel four amino acid insertion in the DNA-binding domain (DBD). We studied corticosteroid activation of CR1 and CR2 and found their strongest response was to 11-deoxycorticosterone and 11-deoxycortisol, the two circulating corticosteroids in lamprey. Based on steroid specificity, both CRs are close to elephant shark MR and distant from elephant shark GR. HEK293 cells transfected with full-length CR1 or CR2 and the MMTV promoter have about 3-fold higher steroid-mediated activation compared to HEK293 cells transfected with these CRs and the TAT3 promoter. Deletion of the amino-terminal domain (NTD) of lamprey CR1 and CR2 to form truncated CRs decreased transcriptional activation by about 70% in HEK293 cells transfected with MMTV, but increased transcription by about 6-fold in cells transfected with TAT3, indicating that the promoter has an important effect on NTD regulation of CR transcription by corticosteroids.


title: Leveraging progressive model and overfitting for efficient learned image compression

abstract: Deep learning is overwhelmingly dominant in the field of computer vision and image/video processing for the last decade. However, for image and video compression, it lags behind the traditional techniques based on discrete cosine transform (DCT) and linear filters. Built on top of an autoencoder architecture, learned image compression (LIC) systems have drawn enormous attention in recent years. Nevertheless, the proposed LIC systems are still inferior to the state-of-the-art traditional techniques, for example, the Versatile Video Coding (VVC/H.266) standard, due to either their compression performance or decoding complexity. Although claimed to outperform the VVC/H.266 on a limited bit rate range, some proposed LIC systems take over 40 seconds to decode a 2K image on a GPU system. In this paper, we introduce a powerful and flexible LIC framework with multi-scale progressive (MSP) probability model and latent representation overfitting (LOF) technique. With different predefined profiles, the proposed framework can achieve various balance points between compression efficiency and computational complexity. Experiments show that the proposed framework achieves 2.5%, 1.0%, and 1.3% Bjontegaard delta bit rate (BD-rate) reduction over the VVC/H.266 standard on three benchmark datasets on a wide bit rate range. More importantly, the decoding complexity is reduced from O(n) to O(1) compared to many other LIC systems, resulting in over 20 times speedup when decoding 2K images.


title: Multi-species Ion Acceleration in 3D Magnetic Reconnection with Hybrid-kinetic Simulations

abstract: Magnetic reconnection drives multi-species particle acceleration broadly in space and astrophysics. We perform the first 3D hybrid simulations (fluid electrons, kinetic ions) that contain sufficient scale separation to produce nonthermal heavy-ion acceleration, with fragmented flux ropes critical for accelerating all species. We demonstrate the acceleration of all ion species (up to Fe) into power-law spectra with similar indices, by a common Fermi acceleration mechanism. The upstream ion velocities influence the first Fermi reflection for injection. The subsequent onsets of Fermi acceleration are delayed for ions with lower charge-mass ratios (Q/M), until growing flux ropes magnetize them. This leads to a species-dependent maximum energy/nucleon $\propto(Q/M)^\alpha$. These findings are consistent with in-situ observations in reconnection regions, suggesting Fermi acceleration as the dominant multi-species ion acceleration mechanism.

categories: astro-ph.SR astro-ph.HE physics.plasm-ph physics.space-ph


title: Towards Real-Time Temporal Graph Learning

abstract: In recent years, graph representation learning has gained significant popularity, which aims to generate node embeddings that capture features of graphs. One of the methods to achieve this is employing a technique called random walks that captures node sequences in a graph and then learns embeddings for each node using a natural language processing technique called Word2Vec. These embeddings are then used for deep learning on graph data for classification tasks, such as link prediction or node classification. Prior work operates on pre-collected temporal graph data and is not designed to handle updates on a graph in real-time. Real world graphs change dynamically and their entire temporal updates are not available upfront. In this paper, we propose an end-to-end graph learning pipeline that performs temporal graph construction, creates low-dimensional node embeddings, and trains multi-layer neural network models in an online setting. The training of the neural network models is identified as the main performance bottleneck as it performs repeated matrix operations on many sequentially connected low-dimensional kernels. We propose to unlock fine-grain parallelism in these low-dimensional kernels to boost performance of model training.


title: The Study of Dust Formation of Six Tidal Disruption Events

abstract: This paper investigates eleven (UV-)optical-infrared (IR) spectral energy distributions (SEDs) of six tidal disruption events (TDEs), which are ASASSN-14li, ASASSN-15lh, ASASSN-18ul, ASASSN-18zj, PS18kh, and ZTF18acaqdaa. We find that all the SEDs show evident IR excesses. We invoke the blackbody plus dust emission model to fit the SEDs, and find that the model can account for the SEDs. The derived masses of the dust surrounding ASASSN-14li, ASASSN-15lh, ASASSN-18ul, ASASSN-18zj, PS18kh, and ZTF18acaqdaa are respectively $\sim0.7-1.0\,(1.5-2.2)\times10^{-4}\,M_\odot$, $\sim0.6-3.1\,(1.4-6.3)\times10^{-2}\,M_\odot$, $\sim1.0\,(2.8)\times10^{-4}\,M_\odot$, $\sim0.1-1.6\,(0.3-3.3)\times10^{-3}\,M_\odot$, $\sim1.0\,(2.0)\times10^{-3}\,M_\odot$, and $\sim 1.1\,(2.9)\times10^{-3}\,M_\odot$, if the dust is graphite (silicate). The temperature of the graphite (silicate) dust of the six TDEs are respectively $\sim1140-1430\,(1210-1520)$\,K, $\sim1030-1380\,(1100-1460)$\,K, $\sim1530\,(1540)$\,K, $\sim960-1380\,(1020-1420)$\,K, $\sim900\,(950)$\,K, and $\sim1600\,(1610)$\,K. By comparing the derived temperatures to the vaporization temperature of graphite ($\sim 1900$\,K) and silicate ($\sim 1100-1500$\,K), we suggest that the IR excesses of PS18kh can be explained by both the graphite and silicate dust, the rest five TDEs favor the graphite dust while the silicate dust model cannot be excluded. Moreover, we demonstrate the lower limits of the radii of the dust shells surrounding the six TDEs are significantly larger than those of the radii of the photospheres at the first epochs of SEDs, indicating that the dust might exist before the the TDEs occurred.


title: Distributed-order space-time fractional diffusions in bounded domains

abstract: We provide explicit classical solutions and stochastic analogues for distributed-order space-time fractional diffusion equations on bounded domains with zero exterior boundary conditions. We also show that our results still hold when the mixing measure in the distributed-order time-derivative is singular.


title: The POLARBEAR-2 and Simons Array Focal Plane Fabrication Status

abstract: We present on the status of POLARBEAR-2 A (PB2-A) focal plane fabrication. The PB2-A is the first of three telescopes in the Simon Array (SA), which is an array of three cosmic microwave background (CMB) polarization sensitive telescopes located at the POLARBEAR (PB) site in Northern Chile. As the successor to the PB experiment, each telescope and receiver combination is named as PB2-A, PB2-B, and PB2-C. PB2-A and -B will have nearly identical receivers operating at 90 and 150 GHz while PB2-C will house a receiver operating at 220 and 270 GHz. Each receiver contains a focal plane consisting of seven close-hex packed lenslet coupled sinuous antenna transition edge sensor bolometer arrays. Each array contains 271 di-chroic optical pixels each of which have four TES bolometers for a total of 7588 detectors per receiver. We have produced a set of two types of candidate arrays for PB2-A. The first we call Version 11 (V11) and uses a silicon oxide (SiOx) for the transmission lines and cross-over process for orthogonal polarizations. The second we call Version 13 (V13) and uses silicon nitride (SiNx) for the transmission lines and cross-under process for orthogonal polarizations. We have produced enough of each type of array to fully populate the focal plane of the PB2-A receiver. The average wirebond yield for V11 and V13 arrays is 93.2% and 95.6% respectively. The V11 arrays had a superconducting transition temperature (Tc) of 452 +/- 15 mK, a normal resistance (Rn) of 1.25 +/- 0.20 Ohms, and saturations powers of 5.2 +/- 1.0 pW and 13 +/- 1.2 pW for the 90 and 150 GHz bands respectively. The V13 arrays had a superconducting transition temperature (Tc) of 456 +/-6 mK, a normal resistance (Rn) of 1.1 +/- 0.2 Ohms, and saturations powers of 10.8 +/- 1.8 pW and 22.9 +/- 2.6 pW for the 90 and 150 GHz bands respectively.


title: Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

abstract: The optimal stopping problem is one of the core problems in financial markets, with broad applications such as pricing American and Bermudan options. The deep BSDE method [Han, Jentzen and E, PNAS, 115(34):8505-8510, 2018] has shown great power in solving high-dimensional forward-backward stochastic differential equations (FBSDEs), and inspired many applications. However, the method solves backward stochastic differential equations (BSDEs) in a forward manner, which can not be used for optimal stopping problems that in general require running BSDE backwardly. To overcome this difficulty, a recent paper [Wang, Chen, Sudjianto, Liu and Shen, arXiv:1807.06622, 2018] proposed the backward deep BSDE method to solve the optimal stopping problem. In this paper, we provide the rigorous theory for the backward deep BSDE method. Specifically, 1. We derive the a posteriori error estimation, i.e., the error of the numerical solution can be bounded by the training loss function; and; 2. We give an upper bound of the loss function, which can be sufficiently small subject to universal approximations. We give two numerical examples, which present consistent performance with the proved theory.


title: The UV Excesses of Supernovae and the Implications for Studying Supernovae and Other Optical Transients

abstract: Supernovae (SNe), kilonovae (KNe), tidal disruption events (TDEs), optical afterglows of gamma ray bursts (GRBs), and many other optical transients are important phenomena in time-domain astronomy. Fitting the multi-band light curves (LCs) or the synthesized (pseudo-)bolometric LCs can be used to constrain the physical properties of optical transients. The (UV absorbed) blackbody module is one of the most important modules used to fit the multi-band LCs of optical transients having (UV absorbed) blackbody spectral energy distributions (SEDs). We find, however, that the SEDs of some SNe show UV excesses, which cannot be fitted by the model including a (UV absorbed) blackbody module. We construct the bolometric LCs and employ the (cooling plus) \Ni model to fit the constructed bolometric LCs, obtaining decent fits. Our results demonstrate that the optical transients showing UV excesses cannot be fitted by the multi-band models that include (UV-absorbed) blackbody module, but can be well modeled by constructing and fitting their bolometric LCs.


title: MultiStyleGAN: Multiple One-shot Image Stylizations using a Single GAN

abstract: Image stylization aims at applying a reference style to arbitrary input images. A common scenario is one-shot stylization, where only one example is available for each reference style. Recent approaches for one-shot stylization such as JoJoGAN fine-tune a pre-trained StyleGAN2 generator on a single style reference image. However, such methods cannot generate multiple stylizations without fine-tuning a new model for each style separately. In this work, we present a MultiStyleGAN method that is capable of producing multiple different stylizations at once by fine-tuning a single generator. The key component of our method is a learnable transformation module called Style Transformation Network. It takes latent codes as input, and learns linear mappings to different regions of the latent space to produce distinct codes for each style, resulting in a multistyle space. Our model inherently mitigates overfitting since it is trained on multiple styles, hence improving the quality of stylizations. Our method can learn upwards of $120$ image stylizations at once, bringing $8\times$ to $60\times$ improvement in training time over recent competing methods. We support our results through user studies and quantitative results that indicate meaningful improvements over existing methods.


title: Cognitive Models as Simulators: The Case of Moral Decision-Making

abstract: To achieve desirable performance, current AI systems often require huge amounts of training data. This is especially problematic in domains where collecting data is both expensive and time-consuming, e.g., where AI systems require having numerous interactions with humans, collecting feedback from them. In this work, we substantiate the idea of $\textit{cognitive models as simulators}$, which is to have AI systems interact with, and collect feedback from, cognitive models instead of humans, thereby making their training process both less costly and faster. Here, we leverage this idea in the context of moral decision-making, by having reinforcement learning (RL) agents learn about fairness through interacting with a cognitive model of the Ultimatum Game (UG), a canonical task in behavioral and brain sciences for studying fairness. Interestingly, these RL agents learn to rationally adapt their behavior depending on the emotional state of their simulated UG responder. Our work suggests that using cognitive models as simulators of humans is an effective approach for training AI systems, presenting an important way for computational cognitive science to make contributions to AI.


title: Inferring Line-of-Sight Velocities and Doppler Widths from Stokes Profiles of GST/NIRIS Using Stacked Deep Neural Networks

abstract: Obtaining high-quality magnetic and velocity fields through Stokes inversion is crucial in solar physics. In this paper, we present a new deep learning method, named Stacked Deep Neural Networks (SDNN), for inferring line-of-sight (LOS) velocities and Doppler widths from Stokes profiles collected by the Near InfraRed Imaging Spectropolarimeter (NIRIS) on the 1.6 m Goode Solar Telescope (GST) at the Big Bear Solar Observatory (BBSO). The training data of SDNN is prepared by a Milne-Eddington (ME) inversion code used by BBSO. We quantitatively assess SDNN, comparing its inversion results with those obtained by the ME inversion code and related machine learning (ML) algorithms such as multiple support vector regression, multilayer perceptrons and a pixel-level convolutional neural network. Major findings from our experimental study are summarized as follows. First, the SDNN-inferred LOS velocities are highly correlated to the ME-calculated ones with the Pearson product-moment correlation coefficient being close to 0.9 on average. Second, SDNN is faster, while producing smoother and cleaner LOS velocity and Doppler width maps, than the ME inversion code. Third, the maps produced by SDNN are closer to ME's maps than those from the related ML algorithms, demonstrating the better learning capability of SDNN than the ML algorithms. Finally, comparison between the inversion results of ME and SDNN based on GST/NIRIS and those from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory in flare-prolific active region NOAA 12673 is presented. We also discuss extensions of SDNN for inferring vector magnetic fields with empirical evaluation.


title: DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problems

abstract: Recently, deep reinforcement learning (DRL) models have shown promising results in solving NP-hard Combinatorial Optimization (CO) problems. However, most DRL solvers can only scale to a few hundreds of nodes for combinatorial optimization problems on graphs, such as the Traveling Salesman Problem (TSP). This paper addresses the scalability challenge in large-scale combinatorial optimization by proposing a novel approach, namely, DIMES. Unlike previous DRL methods which suffer from costly autoregressive decoding or iterative refinements of discrete solutions, DIMES introduces a compact continuous space for parameterizing the underlying distribution of candidate solutions. Such a continuous space allows stable REINFORCE-based training and fine-tuning via massively parallel sampling. We further propose a meta-learning framework to enable the effective initialization of model parameters in the fine-tuning stage. Extensive experiments show that DIMES outperforms recent DRL-based methods on large benchmark datasets for Traveling Salesman Problems and Maximal Independent Set problems.


title: Generalized energy and gradient flow via graph framelets

abstract: In this work, we provide a theoretical understanding of the framelet-based graph neural networks through the perspective of energy gradient flow. By viewing the framelet-based models as discretized gradient flows of some energy, we show it can induce both low-frequency and high-frequency-dominated dynamics, via the separate weight matrices for different frequency components. This substantiates its good empirical performance on both homophilic and heterophilic graphs. We then propose a generalized energy via framelet decomposition and show its gradient flow leads to a novel graph neural network, which includes many existing models as special cases. We then explain how the proposed model generally leads to more flexible dynamics, thus potentially enhancing the representation power of graph neural networks.


title: Test of quantum nonlocality via vector meson decays to $K_SK_S$

abstract: In the system of a pair of quantum-entangled neutral kaons from meson decays, when one kaon collapses into the $K_S$ state, the other will collapse instantaneously into the $K_L$ state due to entanglement and nonlocality. However, if the alternative hypothesis is correct and there's a time window during which one kaon is unaware that the other has decayed, some quantum mechanically prohibited $K_SK_S$ decays may occur. We calculate the branching ratios of $K_SK_S$ in vector meson decays under the locality hypothesis and compare them with experimental results. We show that the branching ratio of $J/\psi\rightarrow K_SK_S$ under locality assumption is already excluded by the BESIII experimental upper limit. Additional experimental results are proposed to perform this test in the future.


title: HEGEL: Hypergraph Transformer for Long Document Summarization

abstract: Extractive summarization for long documents is challenging due to the extended structured input context. The long-distance sentence dependency hinders cross-sentence relations modeling, the critical step of extractive summarization. This paper proposes HEGEL, a hypergraph neural network for long document summarization by capturing high-order cross-sentence relations. HEGEL updates and learns effective sentence representations with hypergraph transformer layers and fuses different types of sentence dependencies, including latent topics, keywords coreference, and section structure. We validate HEGEL by conducting extensive experiments on two benchmark datasets, and experimental results demonstrate the effectiveness and efficiency of HEGEL.


title: Towards Efficient Neural Scene Graphs by Learning Consistency Fields

abstract: Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, computationally heavy ray marching for every image frame becomes a huge burden. In this paper, taking advantage of significant redundancy across adjacent frames in videos, we propose a feature-reusing framework. From the first try of naively reusing the NSG features, however, we learn that it is crucial to disentangle object-intrinsic properties consistent across frames from transient ones. Our proposed method, \textit{Consistency-Field-based NSG (CF-NSG)}, reformulates neural radiance fields to additionally consider \textit{consistency fields}. With disentangled representations, CF-NSG takes full advantage of the feature-reusing scheme and performs an extended degree of scene manipulation in a more controllable manner. We empirically verify that CF-NSG greatly improves the inference efficiency by using 85\% less queries than NSG without notable degradation in rendering quality. Code will be available at: https://github.com/ldynx/CF-NSG


title: Excess backgrounds in Dark Matter detectors and physics of glasses

abstract: In solid-state dark matter detectors, energy accumulation due to ionizing radiation should produce delayed low-energy background similar to the background produced by energy deposited by mechanical stress. The tunneling two-level systems model for glasses is missing interactions between excitation; in contrast, interactions lead to emerging phenomena in Prigogine consideration of systems with energy flow. We observed energy accumulation and delayed release as delayed luminescence in sodium iodine and delayed luminescence suppression by exposure to red light. More studies of fast and delayed luminescence are required.


title: New Approach for Vorticity Estimates of Solutions of the Navier-Stokes Equations

abstract: We develop a new approach for regularity estimates, especially vorticity estimates, of solutions of the three-dimensional Navier-Stokes equations with periodic initial data, by exploiting carefully formulated linearized vorticity equations. An appealing feature of the linearized vorticity equations is the inheritance of the divergence-free property of solutions, so that it can intrinsically be employed to construct and estimate solutions of the Navier-Stokes equations. New regularity estimates of strong solutions of the three-dimensional Navier-Stokes equations are obtained by deriving new explicit a priori estimates for the heat kernel (i.e., the fundamental solution) of the corresponding heterogeneous drift-diffusion operator. These new a priori estimates are derived by using various functional integral representations of the heat kernel in terms of the associated diffusion processes and their conditional laws, including a Bismut-type formula for the gradient of the heat kernel. Then the a priori estimates of solutions of the linearized vorticity equations are established by employing a Feynman-Kac-type formula. The existence of strong solutions and their regularity estimates up to a time proportional to the reciprocal of the square of the maximum initial vorticity are established. All the estimates established in this paper contain known constants that can be explicitly computed.

categories: math.AP math-ph math.CA math.MP math.PR physics.flu-dyn


title: $L^2$ representation of Simpson-Mochizuki's prolongation of Higgs bundles and the Kawamata-Viehweg vanishing theorem for semistable parabolic Higgs bundles

abstract: In this paper, we provide an $L^2$ fine resolution of the prolongation of a nilpotent harmonic bundle in the sense of Simpson-Mochizuki (an analytic analogue of the Kashiwara-Malgrange filtrations). This is the logarithmic analogue of Cattani-Kaplan-Schmid's and Kashiwara-Kawai's results on the $L^2$ interpretation of the intersection complex. As an application, we give an $L^2$-theoretic proof to the Nadel-Kawamata-Viehweg vanishing theorem with coefficients in a nilpotent Higgs bundle.


title: Koll\'ar's Package for Twisted Saito's S-sheaves

abstract: We generalize Koll\'ar's conjecture (including torsion freeness, injectivity theorem, vanishing theorem and decomposition theorem) to Saito's $S$-sheaves twisted by a $\mathbb{Q}$-divisor. This gives a uniform treatment for various kinds of Koll\'ar's package in different topics in complex geometry. As a consequence we prove Koll\'ar's package of pluricanonical bundles twisted by a certain multiplier ideal sheaf. The method of the present paper is $L^2$-theoretic.


title: Performances of Symmetric Loss for Private Data from Exponential Mechanism

abstract: This study explores the robustness of learning by symmetric loss on private data. Specifically, we leverage exponential mechanism (EM) on private labels. First, we theoretically re-discussed properties of EM when it is used for private learning with symmetric loss. Then, we propose numerical guidance of privacy budgets corresponding to different data scales and utility guarantees. Further, we conducted experiments on the CIFAR-10 dataset to present the traits of symmetric loss. Since EM is a more generic differential privacy (DP) technique, it being robust has the potential for it to be generalized, and to make other DP techniques more robust.


title: Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains

abstract: Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not typically generalize well to specific domains such as medical images that have fundamentally shifted distributions compared to natural images. Building generative models for medical images that faithfully depict clinical context may help alleviate the paucity of healthcare datasets. Thus, in this study, we seek to research and expand the representational capabilities of large pretrained foundation models to medical concepts, specifically for leveraging the Stable Diffusion model to generate domain specific images found in medical imaging. We explore the sub-components of the Stable Diffusion pipeline (the variational autoencoder, the U-Net and the text-encoder) to fine-tune the model to generate medical images. We benchmark the efficacy of these efforts using quantitative image quality metrics and qualitative radiologist-driven evaluations that accurately represent the clinical content of conditional text prompts. Our best-performing model improves upon the stable diffusion baseline and can be conditioned to insert a realistic-looking abnormality on a synthetic radiology image, while maintaining a 95% accuracy on a classifier trained to detect the abnormality.


title: The Fokker-Planck formalism for closed bosonic strings

abstract: Every Riemann surface with genus $g$ and $n$ punctures admits a hyperbolic metric, if $2g-2+n>0$. Such a surface can be decomposed into pairs of pants whose boundaries are geodesics. We construct a string field theory for closed bosonic strings based on this pants decomposition. In order to do so, we derive a recursion relation satisfied by the off-shell amplitudes, using the Mirzakhani's scheme for computing integrals over the moduli space of bordered Riemann surfaces. The recursion relation can be turned into a string field theory via the Fokker-Planck formalism. The Fokker-Planck Hamiltonian consists of kinetic terms and three string vertices. Unfortunately, the worldsheet BRST symmetry is not manifest in the theory thus constructed. We will show that the invariance can be made manifest by introducing auxiliary fields.


title: VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment

abstract: Vision-language pre-training (VLP) has recently proven highly effective for various uni- and multi-modal downstream applications. However, most existing end-to-end VLP methods use high-resolution image-text box data to perform well on fine-grained region-level tasks, such as object detection, segmentation, and referring expression comprehension. Unfortunately, such high-resolution images with accurate bounding box annotations are expensive to collect and use for supervision at scale. In this work, we propose VoLTA (Vision-Language Transformer with weakly-supervised local-feature Alignment), a new VLP paradigm that only utilizes image-caption data but achieves fine-grained region-level image understanding, eliminating the use of expensive box annotations. VoLTA adopts graph optimal transport-based weakly-supervised alignment on local image patches and text tokens to germinate an explicit, self-normalized, and interpretable low-level matching criterion. In addition, VoLTA pushes multi-modal fusion deep into the uni-modal backbones during pre-training and removes fusion-specific transformer layers, further reducing memory requirements. Extensive experiments on a wide range of vision- and vision-language downstream tasks demonstrate the effectiveness of VoLTA on fine-grained applications without compromising the coarse-grained downstream performance, often outperforming methods using significantly more caption and box annotations.


title: Creation of Chiral Interface Channels for Quantized Transport in Magnetic Topological Insulator Multilayer Heterostructures

abstract: One-dimensional (1D) topologically protected states are usually formed at the interface between two-dimensional (2D) materials with different topological invariants. Therefore, 1D chiral interface channels (CICs) can be created at the boundary of two quantum anomalous Hall (QAH) insulators with different Chern numbers. Such a QAH junction can function as a chiral edge current distributer at zero magnetic field, but its realization remains challenging. Here, by employing an in-situ mechanical mask, we use molecular beam epitaxy (MBE) to synthesize QAH insulator junctions, in which two QAH insulators with different Chern numbers are connected along a 1D junction. For the junction between C = 1 and C = -1 QAH insulators, we observe quantized transport and demonstrate the appearance of the two parallel propagating CICs along the magnetic domain wall at zero magnetic field. Moreover, since the Chern number of the QAH insulators in magnetic topological insulator (TI)/TI multilayers can be tuned by altering magnetic TI/TI bilayer periods, the junction between two QAH insulators with arbitrary Chern numbers can be achieved by growing different periods of magnetic TI/TI on the two sides of the sample. For the junction between C = 1 and C = 2 QAH insulators, our quantized transport shows that a single CIC appears at the interface. Our work lays down the foundation for the development of QAH insulator-based electronic and spintronic devices, topological chiral networks, and topological quantum computations.