title: Ananke: A Python Package For Causal Inference Using Graphical Models

abstract: We implement Ananke: an object-oriented Python package for causal inference with graphical models. At the top of our inheritance structure is an easily extensible Graph class that provides an interface to several broadly useful graph-based algorithms and methods for visualization. We use best practices of object-oriented programming to implement subclasses of the Graph superclass that correspond to types of causal graphs that are popular in the current literature. This includes directed acyclic graphs for modeling causally sufficient systems, acyclic directed mixed graphs for modeling unmeasured confounding, and chain graphs for modeling data dependence and interference. Within these subclasses, we implement specialized algorithms for common statistical and causal modeling tasks, such as separation criteria for reading conditional independence, nonparametric identification, and parametric and semiparametric estimation of model parameters. Here, we present a broad overview of the package and example usage for a problem with unmeasured confounding. Up to date documentation is available at \url{https://ananke.readthedocs.io/en/latest/}.


title: Studying the resonance production cross-section of the heavy vectors within Heavy Vector Triplet model

abstract: In the context of TeV-scale extensions of the Standard Model both the experimental searches and the construction of phenomenological models for the new heavy bosons searches are used by us. Heavy particles predicted by a the Simplified Model constructed to describe only the on-shell resonance, have to be compared with LHC data. Heavy bosons have certain properties that can be calculated within the Heavy Vector Triplet model using the MadGraph computer program. We have calculated the production cross sections of heavy particles using the experimental constraints in the parameter space ($c_H$, $c_F$) imposed on the benchmark scenario. The nature of the functional dependence of the cross section at the basic parameters of the model on the mass of the new boson, as well as the mechanism for the heavy particle production is studied.


title: Alien Coding

abstract: We introduce a self-learning algorithm for synthesizing programs for OEIS sequences. The algorithm starts from scratch initially generating programs at random. Then it runs many iterations of a self-learning loop that interleaves (i) training neural machine translation to learn the correspondence between sequences and the programs discovered so far, and (ii) proposing many new programs for each OEIS sequence by the trained neural machine translator. The algorithm discovers on its own programs for more than 78000 OEIS sequences, sometimes developing unusual programming methods. We analyze its behavior and the invented programs in several experiments.


title: Analog Schwarzschild black holes of Bose-Einstein condensates in a cavity: Quasinormal modes and quasibound states

abstract: Analog models of black holes have unequivocally proven to be extremely beneficial in providing critical information regarding black hole spectroscopy, superradiance, quantum phenomena and most importantly Hawking radiation and black hole evaporation; topics that have either recently begun to bloom through gravitational wave observations or have not yet been investigated in astrophysical setups. Black hole analog experiments have made astonishing steps toward the aforementioned directions and are paramount in understanding the quantum nature of the gravitational field. Recently, a tabletop analog Schwarzschild black hole has been proposed by placing Bose-Einstein condensates of photons inside a mirror's cavity, leading to a sink with a radial vortex that represents a velocity singularity. Here, we provide an extensive spectral analysis of both the tabletop acoustic black hole and its higher-dimensional gravitational analog. We find that quasinormal modes and quasibound states share qualitative similarities in both systems and show that the eikonal quasinormal modes of the analog acoustic black hole have a photon-sphere-like interpretation, which points to the existence of a phonon sphere in the analog black hole. Our results, complemented with the recently calculated graybody factors and Hawking radiation of the acoustic analog, can provide a theoretical test bed for future tabletop experiments with condensates of light in a mirror's cavity and provide significant insights regarding classical and quantum phenomena in higher-dimensional black holes.


title: Are Equivariant Equilibrium Approximators Beneficial?

abstract: Recently, remarkable progress has been made by approximating Nash equilibrium (NE), correlated equilibrium (CE), and coarse correlated equilibrium (CCE) through function approximation that trains a neural network to predict equilibria from game representations. Furthermore, equivariant architectures are widely adopted in designing such equilibrium approximators in normal-form games. In this paper, we theoretically characterize benefits and limitations of equivariant equilibrium approximators. For the benefits, we show that they enjoy better generalizability than general ones and can achieve better approximations when the payoff distribution is permutation-invariant. For the limitations, we discuss their drawbacks in terms of equilibrium selection and social welfare. Together, our results help to understand the role of equivariance in equilibrium approximators.


title: Diffusion Denoising for Low-Dose-CT Model

abstract: Low-dose Computed Tomography (LDCT) reconstruction is an important task in medical image analysis. Recent years have seen many deep learning based methods, proved to be effective in this area. However, these methods mostly follow a supervised architecture, which needs paired CT image of full dose and quarter dose, and the solution is highly dependent on specific measurements. In this work, we introduce Denoising Diffusion LDCT Model, dubbed as DDLM, generating noise-free CT image using conditioned sampling. DDLM uses pretrained model, and need no training nor tuning process, thus our proposal is in unsupervised manner. Experiments on LDCT images have shown comparable performance of DDLM using less inference time, surpassing other state-of-the-art methods, proving both accurate and efficient. Implementation code will be set to public soon.


title: Geodesics and gravitational waves in chaotic extreme-mass-ratio inspirals: the curious case of Zipoy-Voorhees black-hole mimickers

abstract: Due to the growing capacity of gravitational-wave astronomy and black-hole imaging, we will soon be able to emphatically decide if astrophysical objects lurking in galactic centers are black holes. Sgr A*, one of the most prolific astronomical radio sources in our galaxy, is the focal point for tests of general relativity. Current mass and spin constraints predict that the central object of the Milky Way is supermassive and slowly rotating, thus can be conservatively modeled as a Schwarzschild black hole. The well-established presence of accretion disks and astrophysical environments around supermassive objects can deform their geometry and complicate their observational scientific yield. Here, we study extreme-mass-ratio binaries comprised of a minuscule secondary object inspiraling onto a supermassive Zipoy-Voorhees compact object; the simplest exact solution of general relativity that describes a static, spheroidal deformation of Schwarzschild spacetime. We examine geodesics of prolate and oblate deformations for generic orbits and reevaluate the non-integrability of Zipoy-Voorhees spacetime through the existence of resonant islands in the orbital phase space. By including radiation loss with post-Newtonian techniques, we evolve stellar-mass secondary objects around a supermassive Zipoy-Voorhees primary and find clear imprints of non-integrability in these systems. The peculiar structure of the primary, allows for, not only typical single crossings of transient resonant islands, that are well-known for non-Kerr objects, but also inspirals that traverse through several islands, in a brief period of time, that lead to multiple glitches in the gravitational-wave frequency evolution of the binary. The detectability of glitches with future spaceborne detectors can, therefore, narrow down the parameter space of exotic solutions that, otherwise, can cast identical shadows with black holes.


title: Particle Interferometry in a Moat Regime

abstract: Dense strongly interacting matter can exhibit regimes with spatial modulations, akin to crystalline phases. In this case particles can have a moat spectrum with minimal energy at nonzero momentum. We show that particle interferometry is a sensitive probe of such a regime in heavy-ion collisions. To this end, we develop a field-theoretical formalism that relates particle spectra to in-medium real-time correlation functions of quantum fields on curved hypersurfaces of spacetime. This is then applied to the study of Bose-Einstein correlations in a moat regime in heavy-ion collisions. The resulting two-particle spectra exhibit peaks at nonzero average pair momentum, in contrast to the two-particle spectra in a normal phase, which peak at zero momentum. These peaks lead to non-trivial structures in the ratio of two-particle correlation functions, which should be experimentally measurable if the resolution in the direction of average pair momentum is sufficiently large. We propose these structures in the correlation-function ratios as clear signature of a moat regime and spatially modulated phases in quantum chromodynamics (QCD).


title: Sub-ppb aerosol detection at a distance of 30 meters by millijoule femtosecond laser pulse filamentation in air

abstract: In this work, sub-ppb aerosol detection is achieved by femtosecond laser filament with a single pulse energy of 4 mJ at a distance of 30 m. A concave mirror with an open aperture of 41.4 cm is employed in an off-axis optical system to focus the femtosecond laser beam and collect the fluorescence of NaCl aerosol. The simulation and experimental results show that the astigmatism can be greatly reduced when femtosecond laser beam is incident non-symmetrically on the concave mirror. Compared with the case that femtosecond laser strikes at the center of the concave mirror, the intensity of the optical filament is increased by 69.5 times, and the detection of limit of sodium chloride aerosol is reduced by 86%, which is down to 0.32 ppb. The improved excitation scheme in this work utilizes the nonsymmetrical beam spot on the concave mirror to compensate the non-symmetry induced by the off-axis setup, reducing the astigmatism of the focusing laser beam and improving the aerosol's detection of limit.


title: Sub-Standards and Mal-Practices: Misinformation's Role in Insular, Polarized, and Toxic Interactions

abstract: How do users and communities respond to news from unreliable sources? How does news from these sources change online conversations? In this work, we examine the role of misinformation in sparking political incivility and toxicity on the social media platform Reddit. Utilizing the Google Jigsaw Perspective API to identify toxicity, hate speech, and other forms of incivility, we find that Reddit comments posted in response to articles on websites known to spread misinformation are 71.4% more likely to be toxic than comments responding to authentic news articles. Identifying specific instances of incivility and utilizing an exponential random graph model, we then show that when reacting to a misinformation story, Reddit users are more likely to be toxic to users of different political beliefs. Finally, utilizing a zero-inflated negative binomial regression, we identify that as the toxicity of subreddits increases, users are more likely to comment on misinformation-related submissions.


title: Projected Subnetworks Scale Adaptation

abstract: Large models support great zero-shot and few-shot capabilities. However, updating these models on new tasks can break performance on previous seen tasks and their zero/few-shot unseen tasks. Our work explores how to update zero/few-shot learners such that they can maintain performance on seen/unseen tasks of previous tasks as well as new tasks. By manipulating the parameter updates of a gradient-based meta learner as the projected task-specific subnetworks, we show improvements for large models to retain seen and zero/few shot task performance in online settings.


title: Machine Learning Approach and Extreme Value Theory to Correlated Stochastic Time Series with Application to Tree Ring Data

abstract: The main goal of machine learning (ML) is to study and improve mathematical models which can be trained with data provided by the environment to infer the future and to make decisions without necessarily having complete knowledge of all influencing elements. In this work, we describe how ML can be a powerful tool in studying climate modeling. Tree ring growth was used as an implementation in different aspects, for example, studying the history of buildings and environment. By growing and via the time, a new layer of wood to beneath its bark by the tree. After years of growing, time series can be applied via a sequence of tree ring widths. The purpose of this paper is to use ML algorithms and Extreme Value Theory in order to analyse a set of tree ring widths data from nine trees growing in Nottinghamshire. Initially, we start by exploring the data through a variety of descriptive statistical approaches. Transforming data is important at this stage to find out any problem in modelling algorithm. We then use algorithm tuning and ensemble methods to improve the k-nearest neighbors (KNN) algorithm. A comparison between the developed method in this study ad other methods are applied. Also, extreme value of the dataset will be more investigated. The results of the analysis study show that the ML algorithms in the Random Forest method would give accurate results in the analysis of tree ring widths data from nine trees growing in Nottinghamshire with the lowest Root Mean Square Error value. Also, we notice that as the assumed ARMA model parameters increased, the probability of selecting the true model also increased. In terms of the Extreme Value Theory, the Weibull distribution would be a good choice to model tree ring data.


title: Talk the Walk: Synthetic Data Generation for Conversational Music Recommendation

abstract: Recommender systems are ubiquitous yet often difficult for users to control, and adjust if recommendation quality is poor. This has motivated conversational recommender systems (CRSs), with control provided through natural language feedback. However, as with most application domains, building robust CRSs requires training data that reflects system usage$\unicode{x2014}$here conversations with user utterances paired with items that cover a wide range of preferences. This has proved challenging to collect scalably using conventional methods. We address the question of whether it can be generated synthetically, building on recent advances in natural language. We evaluate in the setting of item set recommendation, noting the increasing attention to this task motivated by use cases like music, news, and recipe recommendation. We present TalkTheWalk, which synthesizes realistic high-quality conversational data by leveraging domain expertise encoded in widely available curated item collections, generating a sequence of hypothetical yet plausible item sets, then using a language model to produce corresponding user utterances. We generate over one million diverse playlist curation conversations in the music domain, and show these contain consistent utterances with relevant item sets nearly matching the quality of an existing but small human-collected dataset for this task. We demonstrate the utility of the generated synthetic dataset on a conversational item retrieval task and show that it improves over both unsupervised baselines and systems trained on a real dataset.


abstract: Existing Deep Reinforcement Learning (DRL) algorithms suffer from sample inefficiency. Generally, episodic control-based approaches are solutions that leverage highly-rewarded past experiences to improve sample efficiency of DRL algorithms. However, previous episodic control-based approaches fail to utilize the latent information from the historical behaviors (e.g., state transitions, topological similarities, etc.) and lack scalability during DRL training. This work introduces Neural Episodic Control with State Abstraction (NECSA), a simple but effective state abstraction-based episodic control containing a more comprehensive episodic memory, a novel state evaluation, and a multi-step state analysis. We evaluate our approach to the MuJoCo and Atari tasks in OpenAI gym domains. The experimental results indicate that NECSA achieves higher sample efficiency than the state-of-the-art episodic control-based approaches. Our data and code are available at the project website\footnote{\url{https://sites.google.com/view/drl-necsa}}.


title: Change point detection and inference in multivariable nonparametric models under mixing conditions

abstract: This paper studies multivariate nonparametric change point localization and inference problems. The data consists of a multivariate time series with potentially short range dependence. The distribution of this data is assumed to be piecewise constant with densities in a H\"{o}lder class. The change points, or times at which the distribution changes, are unknown. We derive the limiting distributions of the change point estimators when the minimal jump size vanishes or remains constant, a first in the literature on change point settings. We are introducing two new features: a consistent estimator that can detect when a change is happening in data with short-term dependence, and a consistent block-type long-run variance estimator. Numerical evidence is provided to back up our theoretical results.


title: Recovering utility

abstract: We provide sufficient conditions under which a utility function may be recovered from a finite choice experiment. Identification, as is commonly understood in decision theory, is not enough. We provide a general recoverability result that is widely applicable to modern theories of choice under uncertainty. Key is to allow for a monetary environment, in which an objective notion of monotonicity is meaningful. In such environments, we show that subjective expected utility, as well as variational preferences, and other parametrizations of utilities over uncertain acts are recoverable. We also consider utility recovery in a statistical model with noise and random deviations from utility maximization.


title: The effect of an unfavorable region on the invasion process of a species

abstract: To model a propagating phenomena through the environment with an unfavorable region, we consider a reaction diffusion equation with negative growth rate in the unfavorable region and bistable reaction outside of it. We study rigorously the influence of $L$, the width of the unfavorable region, on the propagation of solutions. It turns out that there exists a critical value $L^*$ depending only on the reaction term such that, when $L<L^*$, spreading happens for any solution in the sense that it passes through the unfavorable region successfully and establish with minor defect in the region; when $L=L^*$, spreading happens only for a species with large initial population, while residue happens for a population with small initial data, in the sense that the solution converges to a small steady state; when $L>L^*$ we have a trichotomy result: spreading/residue happens for a species with large/small initial population, but, for a species with medium-sized initial data, it can not pass through the region either and converges to a transition steady state.


title: Learning Vortex Dynamics for Fluid Inference and Prediction

abstract: We propose a novel differentiable vortex particle (DVP) method to infer and predict fluid dynamics from a single video. Lying at its core is a particle-based latent space to encapsulate the hidden, Lagrangian vortical evolution underpinning the observable, Eulerian flow phenomena. Our differentiable vortex particles are coupled with a learnable, vortex-to-velocity dynamics mapping to effectively capture the complex flow features in a physically-constrained, low-dimensional space. This representation facilitates the learning of a fluid simulator tailored to the input video that can deliver robust, long-term future predictions. The value of our method is twofold: first, our learned simulator enables the inference of hidden physics quantities (e.g., velocity field) purely from visual observation; secondly, it also supports future prediction, constructing the input video's sequel along with its future dynamics evolution. We compare our method with a range of existing methods on both synthetic and real-world videos, demonstrating improved reconstruction quality, visual plausibility, and physical integrity.


title: Skeleton-based Action Recognition through Contrasting Two-Stream Spatial-Temporal Networks

abstract: For pursuing accurate skeleton-based action recognition, most prior methods use the strategy of combining Graph Convolution Networks (GCNs) with attention-based methods in a serial way. However, they regard the human skeleton as a complete graph, resulting in less variations between different actions (e.g., the connection between the elbow and head in action ``clapping hands''). For this, we propose a novel Contrastive GCN-Transformer Network (ConGT) which fuses the spatial and temporal modules in a parallel way. The ConGT involves two parallel streams: Spatial-Temporal Graph Convolution stream (STG) and Spatial-Temporal Transformer stream (STT). The STG is designed to obtain action representations maintaining the natural topology structure of the human skeleton. The STT is devised to acquire action representations containing the global relationships among joints. Since the action representations produced from these two streams contain different characteristics, and each of them knows little information of the other, we introduce the contrastive learning paradigm to guide their output representations of the same sample to be as close as possible in a self-supervised manner. Through the contrastive learning, they can learn information from each other to enrich the action features by maximizing the mutual information between the two types of action representations. To further improve action recognition accuracy, we introduce the Cyclical Focal Loss (CFL) which can focus on confident training samples in early training epochs, with an increasing focus on hard samples during the middle epochs. We conduct experiments on three benchmark datasets, which demonstrate that our model achieves state-of-the-art performance in action recognition.


title: On Excess Mass Behavior in Gaussian Mixture Models with Orlicz-Wasserstein Distances

abstract: Dirichlet Process mixture models (DPMM) in combination with Gaussian kernels have been an important modeling tool for numerous data domains arising from biological, physical, and social sciences. However, this versatility in applications does not extend to strong theoretical guarantees for the underlying parameter estimates, for which only a logarithmic rate is achieved. In this work, we (re)introduce and investigate a metric, named Orlicz-Wasserstein distance, in the study of the Bayesian contraction behavior for the parameters. We show that despite the overall slow convergence guarantees for all the parameters, posterior contraction for parameters happens at almost polynomial rates in outlier regions of the parameter space. Our theoretical results provide new insight in understanding the convergence behavior of parameters arising from various settings of hierarchical Bayesian nonparametric models. In addition, we provide an algorithm to compute the metric by leveraging Sinkhorn divergences and validate our findings through a simulation study.


title: D$^2$CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropouts

abstract: We present D$^2$CSG, a neural model composed of two dual and complementary network branches, with dropouts, for unsupervised learning of compact constructive solid geometry (CSG) representations of 3D CAD shapes. Our network is trained to reconstruct a 3D shape by a fixed-order assembly of quadric primitives, with both branches producing a union of primitive intersections or inverses. A key difference between D$^2$CSG and all prior neural CSG models is its dedicated residual branch to assemble the potentially complex shape complement, which is subtracted from an overall shape modeled by the cover branch. With the shape complements, our network is provably general, while the weight dropout further improves compactness of the CSG tree by removing redundant primitives. We demonstrate both quantitatively and qualitatively that D$^2$CSG produces compact CSG reconstructions with superior quality and more natural primitives than all existing alternatives, especially over complex and high-genus CAD shapes.


title: CLASSY VI: Density, Structure and Size of Galactic Outflows

abstract: Galaxy formation and evolution are regulated by the feedback from galactic winds. Absorption lines provide the most widely available probe of winds. However, since most data only provide information integrated along the line-of-sight, they do not directly constrain the radial structure of the outflows. In this paper, we present a method to directly measure the gas electron density in outflows (ne), which in turn yields estimates of outflow cloud properties (e.g., density, volume filling-factor, and sizes/masses). We also estimate the distance (r) from the starburst at which the observed densities are found. We focus on 22 local star-forming galaxies primarily from the COS Legacy Archive Spectroscopic SurveY (CLASSY). In half of them, we detect absorption lines from fine structure excited transitions of Si II (i.e., Si II*). We determine ne from relative column densities of Si II and Si II*, given Si II* originates from collisional excitation by free electrons. We find that the derived ne correlates well with the galaxy's star-formation rate per unit area. From photoionization models or assuming the outflow is in pressure equilibrium with the wind fluid, we get r ~ 1 to 2 * rstar or ~ 5 * rstar, respectively, where rstar is the starburst radius. Based on comparisons to theoretical models of multi-phase outflows, nearly all of the outflows have cloud sizes large enough for the clouds to survive their interaction with the hot wind fluid. Most of these measurements are the first-ever for galactic winds detected in absorption lines and, thus, will provide important constraints for future models of galactic winds.


title: Dual-View Selective Instance Segmentation Network for Unstained Live Adherent Cells in Differential Interference Contrast Images

abstract: Despite recent advances in data-independent and deep-learning algorithms, unstained live adherent cell instance segmentation remains a long-standing challenge in cell image processing. Adherent cells' inherent visual characteristics, such as low contrast structures, fading edges, and irregular morphology, have made it difficult to distinguish from one another, even by human experts, let alone computational methods. In this study, we developed a novel deep-learning algorithm called dual-view selective instance segmentation network (DVSISN) for segmenting unstained adherent cells in differential interference contrast (DIC) images. First, we used a dual-view segmentation (DVS) method with pairs of original and rotated images to predict the bounding box and its corresponding mask for each cell instance. Second, we used a mask selection (MS) method to filter the cell instances predicted by the DVS to keep masks closest to the ground truth only. The developed algorithm was trained and validated on our dataset containing 520 images and 12198 cells. Experimental results demonstrate that our algorithm achieves an AP_segm of 0.555, which remarkably overtakes a benchmark by a margin of 23.6%. This study's success opens up a new possibility of using rotated images as input for better prediction in cell images.


title: Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing

abstract: It is believed that Gradient Descent (GD) induces an implicit bias towards good generalization in training machine learning models. This paper provides a fine-grained analysis of the dynamics of GD for the matrix sensing problem, whose goal is to recover a low-rank ground-truth matrix from near-isotropic linear measurements. It is shown that GD with small initialization behaves similarly to the greedy low-rank learning heuristics (Li et al., 2020) and follows an incremental learning procedure (Gissin et al., 2019): GD sequentially learns solutions with increasing ranks until it recovers the ground truth matrix. Compared to existing works which only analyze the first learning phase for rank-1 solutions, our result provides characterizations for the whole learning process. Moreover, besides the over-parameterized regime that many prior works focused on, our analysis of the incremental learning procedure also applies to the under-parameterized regime. Finally, we conduct numerical experiments to confirm our theoretical findings.


title: Practical Frequency-Hopping MIMO Joint Radar Communications: Design and Experiment

abstract: Joint radar and communications (JRC) can realize two radio frequency (RF) functions using one set of resources, greatly saving hardware, energy and spectrum for wireless systems needing both functions. Frequency-hopping (FH) MIMO radar is a popular candidate for JRC, as the achieved communication symbol rate can greatly exceed radar pulse repetition frequency. However, practical transceiver imperfections can fail many existing theoretical designs. In this work, we unveil for the first time the non-trivial impact of hardware imperfections on FH-MIMO JRC and analytically model the impact. We also design new waveforms and, accordingly, develop a low-complexity algorithm to jointly estimate the hardware imperfections of unsynchronized receiver. Moreover, employing low-cost software-defined radios and commercial off-the-shelf (COTS) products, we build the first FH-MIMO JRC experiment platform with radar and communications simultaneously validated over the air. Corroborated by simulation and experiment results, the proposed designs achieves high performances for both radar and communications.


title: A Mixed-integer Linear Formulation for Dynamic Modified Stochastic p-Median Problem in a Competitive Supply Chain Network Design

abstract: The Dynamic Modified Stochastic p-Median Problem (DMS-p-MP) is an important problem in supply chain network design, as it deals with the optimal location of facilities and the allocation of demand in a dynamic and uncertain environment. In this research paper, we propose a mixed-integer linear formulation for the DMS-p-MP, which captures the key features of the problem and allows for efficient solution methods. The DMS-p-MP adds two key features to the classical problem: (1) it considers the dynamic nature of the problem, where the demand is uncertain and changes over time, and (2) it allows for the modification of the facility locations over time, subject to a fixed number of modifications. The proposed model is using robust optimization in order to address the uncertainty of demand by allowing for the optimization of solutions that are not overly sensitive to small changes in the data or parameters. To manage the computational challenges presented by large-scale DMS-p-MP networks, a Lagrangian relaxation (LR) algorithm is employed. Our computational study in a real-life case study demonstrates the effectiveness of the proposed formulation in solving the DMS p-Median Problem. According to the results, the number of opened and closed buildings remains unchanged as the time horizon increases. This is due to the periodic nature of our demand. This formulation can be applied to real-world problems, providing decision-makers with an effective tool to optimize their supply chain network design in a dynamic and uncertain environment.


title: Candidate Soups: Fusing Candidate Results Improves Translation Quality for Non-Autoregressive Translation

abstract: Non-autoregressive translation (NAT) model achieves a much faster inference speed than the autoregressive translation (AT) model because it can simultaneously predict all tokens during inference. However, its translation quality suffers from degradation compared to AT. And existing NAT methods only focus on improving the NAT model's performance but do not fully utilize it. In this paper, we propose a simple but effective method called "Candidate Soups," which can obtain high-quality translations while maintaining the inference speed of NAT models. Unlike previous approaches that pick the individual result and discard the remainders, Candidate Soups (CDS) can fully use the valuable information in the different candidate translations through model uncertainty. Extensive experiments on two benchmarks (WMT'14 EN-DE and WMT'16 EN-RO) demonstrate the effectiveness and generality of our proposed method, which can significantly improve the translation quality of various base models. More notably, our best variant outperforms the AT model on three translation tasks with 7.6 times speedup.


title: Traveling waves in reaction-diffusion equations with delay in both diffusion and reaction terms

abstract: We study the existence of traveling waves of reaction-diffusion systems with delays in both diffusion and reaction terms of the form $\partial u(x,t)/\partial t = \Delta u(x,t-\tau_1)+f(u(x,t),u(x,t-\tau_2))$, where $\tau_1,\tau_2$ are positive constants. We extend the monotone iteration method to systems that satisfy typical monotone conditions by thoroughly studying the sign of the Green function associated with a linear functional differential equation. Namely, we show that for small positive $r$ the functional equation $x''(t)-ax'(t+r)-bx(t+r)=f(t)$, where $a\not=0, b>0$ has a unique bounded solution for each given bounded and continuous $f(t)$. Moreover, if $r>0$ is sufficiently small, $f(t)\ge 0$ for $t\in {\mathbb R}$, then the unique bounded solution $x_f(t)\le 0$ for all $t\in {\mathbb R}$. In the framework of the monotone iteration method that is developed based on this result, upper and lower solutions are found for Fisher-KPP and Belousov-Zhabotinski equations to show that traveling waves exist for these equations when delays are small in both diffusion and reaction terms. The obtained results appear to be new.


title: Design of an FPGA-based USB 3.0 device controller

abstract: The traditional USB 3.0 communication based on FPGA uses an external chip as a USB PHY or a USB controller including a USB PHY. This paper realizes a USB 3.0 controller by using FPGA resources, in which FPGA logic realizes a serial interface engine, and an FPGA internal transceiver is as a USB PHY. Used slices percent after implementation is 4.59% in Kintex-7 325t. The test result shows that the speed of USB 3.0 is more than 320 MB/s bulk-in and bulk-out transfers.


title: Ginzburg-Landau action and polarization current in an excitonic insulator model of electronic ferroelectricity

abstract: In comparison to transport of spin polarization in ferromagnets, transport of electric polarization in ferroelectrics remains less explored. Taking an excitonic insulator model of electronic ferroelectricity as a prototypical example, we theoretically investigate the low-energy dynamics and transport of electric polarization by microscopically constructing the Ginzburg-Landau action. We show that, because of the scalar nature of the excitonic order parameter, only the longitudinal fluctuations are relevant to the transport of electric polarization. We also formulate the electric polarization diffusion equation, in which the electric-polarization current is defined purely electronically without recourse to the lattice degrees of freedom.


title: Semi-Parametric Video-Grounded Text Generation

abstract: Efficient video-language modeling should consider the computational cost because of a large, sometimes intractable, number of video frames. Parametric approaches such as the attention mechanism may not be ideal since its computational cost quadratically increases as the video length increases. Rather, previous studies have relied on offline feature extraction or frame sampling to represent the video efficiently, focusing on cross-modal modeling in short video clips. In this paper, we propose a semi-parametric video-grounded text generation model, SeViT, a novel perspective on scalable video-language modeling toward long untrimmed videos. Treating a video as an external data store, SeViT includes a non-parametric frame retriever to select a few query-relevant frames from the data store for a given query and a parametric generator to effectively aggregate the frames with the query via late fusion methods. Experimental results demonstrate our method has a significant advantage in longer videos and causal video understanding. Moreover, our model achieves the new state of the art on four video-language datasets, iVQA (+4.8), Next-QA (+6.9), and Activitynet-QA (+4.8) in accuracy, and MSRVTT-Caption (+3.6) in CIDEr.


title: Theme-driven Keyphrase Extraction to Analyze Social Media Discourse

abstract: Social media platforms are vital resources for sharing self-reported health experiences, offering rich data on various health topics. Despite advancements in Natural Language Processing (NLP) enabling large-scale social media data analysis, a gap remains in applying keyphrase extraction to health-related content. Keyphrase extraction is used to identify salient concepts in social media discourse without being constrained by predefined entity classes. This paper introduces a theme-driven keyphrase extraction framework tailored for social media, a pioneering approach designed to capture clinically relevant keyphrases from user-generated health texts. Themes are defined as broad categories determined by the objectives of the extraction task. We formulate this novel task of theme-driven keyphrase extraction and demonstrate its potential for efficiently mining social media text for the use case of treatment for opioid use disorder. This paper leverages qualitative and quantitative analysis to demonstrate the feasibility of extracting actionable insights from social media data and efficiently extracting keyphrases using minimally supervised NLP models. Our contributions include the development of a novel data collection and curation framework for theme-driven keyphrase extraction and the creation of MOUD-Keyphrase, the first dataset of its kind comprising human-annotated keyphrases from a Reddit community. We also identify the scope of minimally supervised NLP models to extract keyphrases from social media data efficiently. Lastly, we found that a large language model (ChatGPT) outperforms unsupervised keyphrase extraction models, and we evaluate its efficacy in this task.


title: Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equation

abstract: Despite their remarkable success in approximating a wide range of operators defined by PDEs, existing neural operators (NOs) do not necessarily perform well for all physics problems. We focus here on high-frequency waves to highlight possible shortcomings. To resolve these, we propose a subfamily of NOs enabling an enhanced empirical approximation of the nonlinear operator mapping wave speed to solution, or boundary values for the Helmholtz equation on a bounded domain. The latter operator is commonly referred to as the ''forward'' operator in the study of inverse problems. Our methodology draws inspiration from transformers and techniques such as stochastic depth. Our experiments reveal certain surprises in the generalization and the relevance of introducing stochastic depth. Our NOs show superior performance as compared with standard NOs, not only for testing within the training distribution but also for out-of-distribution scenarios. To delve into this observation, we offer an in-depth analysis of the Rademacher complexity associated with our modified models and prove an upper bound tied to their stochastic depth that existing NOs do not satisfy. Furthermore, we obtain a novel out-of-distribution risk bound tailored to Gaussian measures on Banach spaces, again relating stochastic depth with the bound. We conclude by proposing a hypernetwork version of the subfamily of NOs as a surrogate model for the mentioned forward operator.


title: Exploring Deep Reinforcement Learning for Holistic Smart Building Control

abstract: In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses a data-driven approach to find the optimal control sequences of all building's subsystems, including HVAC, lighting, blind and window systems. The DRL architecture includes a novel reward function that allows the framework to explore the tradeoffs between energy use and users' comfort, while at the same time enabling the solution of the high-dimensional control problem due to the interactions of four different building subsystems. In order to cope with OCTOPUS's data training requirements, we argue that calibrated simulations that match the target building operational points are the vehicle to generate enough data to be able to train our DRL framework to find the control solution for the target building. In our work, we trained OCTOPUS with 10-year weather data and a building model that is implemented in the EnergyPlus building simulator, which was calibrated using data from a real production building. Through extensive simulations, we demonstrate that OCTOPUS can achieve 14.26% and 8.1% energy savings compared with the state-of-the-art rule-based method in a LEED Gold Certified building and the latest DRL-based method available in the literature respectively, while maintaining human comfort within a desired range.


title: JASS: A Flexible Checkpointing System for NVM-based Systems

abstract: NVM-based systems are naturally fit candidates for incorporating periodic checkpointing (or snapshotting). This increases the reliability of the system, makes it more immune to power failures, and reduces wasted work in especially an HPC setup. The traditional line of thinking is to design a system that is conceptually similar to transactional memory, where we log updates all the time, and minimize the wasted work or alternatively the MTTR (mean time to recovery). Such ``instant recovery'' systems allow the system to recover from a point that is quite close to the point of failure. The penalty that we pay is the prohibitive number of additional writes to the NVM. We propose a paradigmatically different approach in this paper, where we argue that in most practical settings such as regular HPC workloads or neural network training, there is no need for such instant recovery. This means that we can afford to lose some work, take periodic software-initiated checkpoints and still meet the goals of the application. The key benefit of our scheme is that we reduce write amplification substantially; this extends the life of NVMs by roughly the same factor. We go a step further and design an adaptive system that can minimize the WA given a target checkpoint latency, and show that our control algorithm almost always performs near-optimally. Our scheme reduces the WA by 2.3-96\% as compared to the nearest competing work.


title: New Exclusion Limit for Dark Photons from an SRF Cavity-Based Search (Dark SRF)

abstract: We conduct the first ``light-shining-through-wall" (LSW) search for dark photons using two state-of-the-art high quality-factor superconducting radio frequency (SRF) cavities and report the results of its pathfinder run. Our new experimental setup enables improvements in sensitivity over previous searches and covers new dark photon parameter space. We design delicate calibration and measurement protocols to utilize the high-$Q$ setup at Dark SRF. Using cavities operating at $1.3 \ \text{GHz}$, we establish a new exclusion limit for kinetic mixing as small as {$\epsilon= 1.6\times 10^{-9}$} and provide the world's best constraints on dark photons in the $2.1\times 10^{-7} \ \text{eV} - 5.7\times10^{-6} \ \text{eV}$ mass range. Our result is the first proof-of-concept for the enabling role of SRF cavities in LSW setups, with ample opportunities for further improvements. In addition, our data sets a competitive lab-based limit on the Standard Model photon mass by searching for longitudinal photon polarization.


title: CellMix: A General Instance Relationship based Method for Data Augmentation Towards Pathology Image Classification

abstract: In pathology image analysis, obtaining and maintaining high-quality annotated samples is an extremely labor-intensive task. To overcome this challenge, mixing-based methods have emerged as effective alternatives to traditional preprocessing data augmentation techniques. Nonetheless, these methods fail to fully consider the unique features of pathology images, such as local specificity, global distribution, and inner/outer-sample instance relationships. To better comprehend these characteristics and create valuable pseudo samples, we propose the CellMix framework, which employs a novel distribution-oriented in-place shuffle approach. By dividing images into patches based on the granularity of pathology instances and shuffling them within the same batch, the absolute relationships between instances can be effectively preserved when generating new samples. Moreover, we develop a curriculum learning-inspired, loss-driven strategy to handle perturbations and distribution-related noise during training, enabling the model to adaptively fit the augmented data. Our experiments in pathology image classification tasks demonstrate state-of-the-art (SOTA) performance on 7 distinct datasets. This innovative instance relationship-centered method has the potential to inform general data augmentation approaches for pathology image classification. The associated codes are available at https://github.com/sagizty/CellMix.


title: Deep Industrial Image Anomaly Detection: A Survey

abstract: The recent rapid development of deep learning has laid a milestone in industrial Image Anomaly Detection (IAD). In this paper, we provide a comprehensive review of deep learning-based image anomaly detection techniques, from the perspectives of neural network architectures, levels of supervision, loss functions, metrics and datasets. In addition, we extract the new setting from industrial manufacturing and review the current IAD approaches under our proposed our new setting. Moreover, we highlight several opening challenges for image anomaly detection. The merits and downsides of representative network architectures under varying supervision are discussed. Finally, we summarize the research findings and point out future research directions. More resources are available at https://github.com/M-3LAB/awesome-industrial-anomaly-detection.


title: Secrecy Analysis for MISO Broadcast Systems with Regularized Zero-Forcing Precoding

abstract: As an effective way to enhance the physical layer security (PLS) for the broadcast channel (BC), regularized zero-forcing (RZF) precoding has attracted much attention. However, the reliability performance, i.e., secrecy outage probability (SOP), of RZF is not well investigated in the literature. In this paper, we characterize the secrecy performance of RZF precoding in the large multiple-input single-output (MISO) broadcast system. For this purpose, we first consider a central limit theorem (CLT) for the joint distribution of the users' signal-to-interference-plus-noise ratio (SINR) and the eavesdropper's (Eve's) signal-to-noise ratio (ESNR) by leveraging random matrix theory (RMT). The result is then utilized to obtain a closed-form approximation for the ergodic secrecy rate (ESR) and SOP of three typical scenarios: the case with only external Eves, the case with only internal Eves, and that with both. The derived results are then used to evaluate the percentage of users in secrecy outage and the required number of transmit antennas to achieve a positive secrecy rate. It is shown that, with equally-capable Eves, the secrecy loss caused by external Eves is higher than that caused by internal Eves. Numerical simulations validate the accuracy of the theoretical results.


title: Is Embodied Interaction Beneficial? A Study on Navigating Network Visualizations

abstract: Network visualizations are commonly used to analyze relationships in various contexts. To efficiently explore a network visualization, the user needs to quickly navigate to different parts of the network and analyze local details. Recent advancements in display and interaction technologies inspire new visions for improved visualization and interaction design. Past research into network design has identified some key benefits to visualizing networks in 3D versus 2D. However, little work has been done to study the impact of varying levels of embodied interaction on network analysis. We present a controlled user study that compared four environments featuring conditions and hardware that leveraged different amounts of embodiment and visual perception ranging from a 2D visualization desktop environment with a standard mouse to a 3D visualization virtual reality environment. We measured the accuracy, speed, perceived workload, and preferences of 20 participants as they completed three network analytic tasks, each of which required unique navigation and substantial effort. For the task that required participants to iterate over the entire visualization rather than focus on a specific area, we found that participants were more accurate using a VR and a trackball mouse than conventional desktop settings. From a workload perspective, VR was generally considered the least mentally demanding and least frustrating in two of our three tasks. It was also preferred and ranked as the most effective and visually appealing condition overall. However, using VR to compare two side-by-side networks was difficult, and it was similar to or slower than other conditions in two of the three tasks. Overall, the accuracy and workload advantages of conditions with greater embodiment in specific tasks suggest promising opportunities to create more effective environments in which to analyze network visualizations.


title: Task-Agnostic Graph Neural Network Evaluation via Adversarial Collaboration

abstract: It has been increasingly demanding to develop reliable methods to evaluate the progress of Graph Neural Network (GNN) research for molecular representation learning. Existing GNN benchmarking methods for molecular representation learning focus on comparing the GNNs' performances on some node/graph classification/regression tasks on certain datasets. However, there lacks a principled, task-agnostic method to directly compare two GNNs. Additionally, most of the existing self-supervised learning works incorporate handcrafted augmentations to the data, which has several severe difficulties to be applied on graphs due to their unique characteristics. To address the aforementioned issues, we propose GraphAC (Graph Adversarial Collaboration) -- a conceptually novel, principled, task-agnostic, and stable framework for evaluating GNNs through contrastive self-supervision. We introduce a novel objective function: the Competitive Barlow Twins, that allow two GNNs to jointly update themselves from direct competitions against each other. GraphAC succeeds in distinguishing GNNs of different expressiveness across various aspects, and has demonstrated to be a principled and reliable GNN evaluation method, without necessitating any augmentations.


title: Online Learning in Stackelberg Games with an Omniscient Follower

abstract: We study the problem of online learning in a two-player decentralized cooperative Stackelberg game. In each round, the leader first takes an action, followed by the follower who takes their action after observing the leader's move. The goal of the leader is to learn to minimize the cumulative regret based on the history of interactions. Differing from the traditional formulation of repeated Stackelberg games, we assume the follower is omniscient, with full knowledge of the true reward, and that they always best-respond to the leader's actions. We analyze the sample complexity of regret minimization in this repeated Stackelberg game. We show that depending on the reward structure, the existence of the omniscient follower may change the sample complexity drastically, from constant to exponential, even for linear cooperative Stackelberg games. This poses unique challenges for the learning process of the leader and the subsequent regret analysis.


title: Spinning Metasurface Stack for Spectro-polarimetric Thermal Imaging

abstract: Spectro-polarimetric imaging in the long-wave infrared (LWIR) region plays a crucial role in applications from night vision and machine perception to trace gas sensing and thermography. However, the current generation of spectro-polarimetric LWIR imagers suffer from limitations in size, spectral resolution and field of view (FOV). While meta-optics-based strategies for spectro-polarimetric imaging have been explored in the visible spectrum, their potential for thermal imaging remains largely unexplored. In this work, we introduce a novel approach for spectro-polarimetric decomposition by combining large-area stacked meta-optical devices with advanced computational imaging algorithms. The co-design of a stack of spinning dispersive metasurfaces along with compressed sensing and dictionary learning algorithms allows simultaneous spectral and polarimetric resolution without the need for bulky filter wheels or interferometers. Our spinning-metasurface-based spectro polarimetric stack is compact (< 10 x 10 x 10 cm), robust, and offers a wide field of view (20.5{\deg}). We show that the spectral resolving power of our system substantially enhances performance in machine learning tasks such as material classification, a challenge for conventional panchromatic thermal cameras. Our approach represents a significant advance in the field of thermal imaging for a wide range of applications including heat-assisted detection and ranging (HADAR).


title: SNeRL: Semantic-aware Neural Radiance Fields for Reinforcement Learning

abstract: As previous representations for reinforcement learning cannot effectively incorporate a human-intuitive understanding of the 3D environment, they usually suffer from sub-optimal performances. In this paper, we present Semantic-aware Neural Radiance Fields for Reinforcement Learning (SNeRL), which jointly optimizes semantic-aware neural radiance fields (NeRF) with a convolutional encoder to learn 3D-aware neural implicit representation from multi-view images. We introduce 3D semantic and distilled feature fields in parallel to the RGB radiance fields in NeRF to learn semantic and object-centric representation for reinforcement learning. SNeRL outperforms not only previous pixel-based representations but also recent 3D-aware representations both in model-free and model-based reinforcement learning.


title: Stack-Aware Hyperproperties

abstract: A hyperproperty relates executions of a program and is used to formalize security objectives such as confidentiality, non-interference, privacy, and anonymity. Formally, a hyperproperty is a collection of allowable sets of executions. A program violates a hyperproperty if the set of its executions is not in the collection specified by the hyperproperty. The logic HyperCTL^* has been proposed in the literature to formally specify and verify hyperproperties. The problem of checking whether a finite-state program satisfies a HyperCTL^* formula is known to be decidable. However, the problem turns out to be undecidable for procedural (recursive) programs. Surprisingly, we show that decidability can be restored if we consider restricted classes of hyperproperties, namely those that relate only those executions of a program which have the same call-stack access pattern. We call such hyperproperties, \emph{stack-aware hyperproperties.} Our decision procedure can be used as a proof method for establishing security objectives such as noninference for recursive programs, and also for refuting security objectives such as observational determinism. Further, if the call stack size is observable to the attacker, the decision procedure provides exact verification.


title: A Comparison of Tiny-nerf versus Spatial Representations for 3d Reconstruction

abstract: Neural rendering has emerged as a powerful paradigm for synthesizing images, offering many benefits over classical rendering by using neural networks to reconstruct surfaces, represent shapes, and synthesize novel views, either for objects or scenes. In this neural rendering, the environment is encoded into a neural network. We believe that these new representations can be used to codify the scene for a mobile robot. Therefore, in this work, we perform a comparison between a trending neural rendering, called tiny-NeRF, and other volume representations that are commonly used as maps in robotics, such as voxel maps, point clouds, and triangular meshes. The target is to know the advantages and disadvantages of neural representations in the robotics context. The comparison is made in terms of spatial complexity and processing time to obtain a model. Experiments show that tiny-NeRF requires three times less memory space compared to other representations. In terms of processing time, tiny-NeRF takes about six times more to compute the model.


title: Externally-triggerable optical pump-probe scanning tunneling microscopy with a time resolution of tens-picosecond

abstract: Photoinduced carrier dynamics of nanostructures play a crucial role in developing novel functionalities in advanced materials. Optical pump-probe scanning tunneling microscopy (OPP-STM) represents distinctive capabilities of real-space imaging of such carrier dynamics with nanoscale spatial resolution. However, combining the advanced technology of ultrafast pulsed lasers with STM for stable time-resolved measurements has remained challenging. The recent OPP-STM system, whose laser-pulse timing is electrically controlled by external triggers, has significantly simplified this combination but limited its application due to nanosecond temporal resolution. Here we report an externally-triggerable OPP-STM system with a temporal resolution in the tens-picosecond range. We also realize the stable laser illumination of the tip-sample junction by placing a position-movable aspheric lens driven by piezo actuators directly on the STM stage and by employing an optical beam stabilization system. We demonstrate the OPP-STM measurements on GaAs(110) surfaces, observing carrier dynamics with a decay time of $\sim170$ ps and revealing local carrier dynamics at features including a step edge and a nanoscale defect. The stable OPP-STM measurements with the tens-picosecond resolution by the electrical control of laser pulses highlight the potential capabilities of this system for investigating nanoscale carrier dynamics of a wide range of functional materials.

categories: physics.optics cond-mat.mtrl-sci cond-mat.str-el cond-mat.supr-con


title: RAPTOR: Advanced Persistent Threat Detection in Industrial IoT via Attack Stage Correlation

abstract: Past Advanced Persistent Threat (APT) attacks on Industrial Internet-of-Things (IIoT), such as the 2016 Ukrainian power grid attack and the 2017 Saudi petrochemical plant attack, have shown the disruptive effects of APT campaigns while new IIoT malware continue to be developed by APT groups. Existing APT detection systems have been designed using cyberattack TTPs modelled for enterprise IT networks and leverage specific data sources (e.g., Linux audit logs, Windows event logs) which are not found on ICS devices. In this work, we propose RAPTOR, a system to detect APT campaigns in IIoT. Using cyberattack TTPs modelled for ICS/OT environments and focusing on "invariant" attack phases, RAPTOR detects and correlates various APT attack stages in IIoT leveraging data which can be readily collected from ICS devices/networks (packet traffic traces, IDS alerts). Subsequently, it constructs a high-level APT campaign graph which can be used by cybersecurity analysts towards attack analysis and mitigation. A performance evaluation of RAPTOR's APT attack-stage detection modules shows high precision and low false positive/negative rates. We also show that RAPTOR is able to construct the APT campaign graph for APT attacks (modelled after real-world attacks on ICS/OT infrastructure) executed on our IIoT testbed.


title: Mixed Attention Network for Hyperspectral Image Denoising

abstract: Hyperspectral image denoising is unique for the highly similar and correlated spectral information that should be properly considered. However, existing methods show limitations in exploring the spectral correlations across different bands and feature interactions within each band. Besides, the low- and high-level features usually exhibit different importance for different spatial-spectral regions, which is not fully explored for current algorithms as well. In this paper, we present a Mixed Attention Network (MAN) that simultaneously considers the inter- and intra-spectral correlations as well as the interactions between low- and high-level spatial-spectral meaningful features. Specifically, we introduce a multi-head recurrent spectral attention that efficiently integrates the inter-spectral features across all the spectral bands. These features are further enhanced with a progressive spectral channel attention by exploring the intra-spectral relationships. Moreover, we propose an attentive skip-connection that adaptively controls the proportion of the low- and high-level spatial-spectral features from the encoder and decoder to better enhance the aggregated features. Extensive experiments show that our MAN outperforms existing state-of-the-art methods on simulated and real noise settings while maintaining a low cost of parameters and running time.


title: Direct Parameterization of Lipschitz-Bounded Deep Networks

abstract: This paper introduces a new parameterization of deep neural networks (both fully-connected and convolutional) with guaranteed $\ell^2$ Lipschitz bounds, i.e. limited sensitivity to input perturbations. The Lipschitz guarantees are equivalent to the tightest-known bounds based on certification via a semidefinite program (SDP). We provide a ``direct'' parameterization, i.e., a smooth mapping from $\mathbb R^N$ onto the set of weights satisfying the SDP-based bound. Moreover, our parameterization is complete, i.e. a neural network satisfies the SDP bound if and only if it can be represented via our parameterization. This enables training using standard gradient methods, without any inner approximation or computationally intensive tasks (e.g. projections or barrier terms) for the SDP constraint. The new parameterization can equivalently be thought of as either a new layer type (the \textit{sandwich layer}), or a novel parameterization of standard feedforward networks with parameter sharing between neighbouring layers. A comprehensive set of experiments on image classification shows that sandwich layers outperform previous approaches on both empirical and certified robust accuracy. Code is available at \url{https://github.com/acfr/LBDN}.


title: Opinion-aware Influence Maximization in Online Social Networks

abstract: Influence maximization (IM) aims to find seed users on an online social network to maximize the spread of information about a target product through word-of-mouth propagation among all users. Prior IM methods mostly focus on maximizing the overall influence spread, which assumes that all users are potential customers of the product and that more exposure leads to higher benefits. However, in real-world scenarios, some users who dislike the product may express and spread negative opinions, damaging the product's reputation and lowering its profit. This paper investigates the opinion-aware influence maximization (OIM) problem, which finds a set of seed users to maximize the positive opinions toward the product while minimizing the negative opinions. We propose a novel algorithm for the OIM problem. Specifically, after obtaining the users with positive and negative opinions towards the product from historical data, we design a reverse reachable set-based method for opinion-aware influence estimation and a sandwich approximation algorithm for seed set selection. Despite the NP-hardness and non-submodularity of OIM, our algorithm achieves a data-dependent approximation factor for OIM. Experimental results on three real-world datasets demonstrate that our algorithm improves the spread of positive opinions while reducing the spread of negative opinions compared to existing methods.


title: Low-Rank Structured Clutter Covariance Matrix Estimation for Airborne STAP Radar

abstract: In space-time adaptive processing (STAP) of the airborne radar system, it is very important to realize sparse restoration of the clutter covariance matrix with a small number of samples. In this paper, a clutter suppression method for airborne forward-looking array radar based on joint statistics and structural priority is proposed, which can estimate the clutter covariance matrix in the case of small samples. Assuming that the clutter covariance matrix obeys the inverse Wishart prior distribution, the maximum posterior estimate is obtained by using the low-rank symmetry of the matrix itself. The simulation results based on the radar forward-looking array model show that compared with the traditional covariance matrix estimation method, the proposed method can effectively improve the clutter suppression performance of airborne radar while efficiently calculating.


title: PLay: Parametrically Conditioned Layout Generation using Latent Diffusion

abstract: Layout design is an important task in various design fields, including user interface, document, and graphic design. As this task requires tedious manual effort by designers, prior works have attempted to automate this process using generative models, but commonly fell short of providing intuitive user controls and achieving design objectives. In this paper, we build a conditional latent diffusion model, PLay, that generates parametrically conditioned layouts in vector graphic space from user-specified guidelines, which are commonly used by designers for representing their design intents in current practices. Our method outperforms prior works across three datasets on metrics including FID and FD-VG, and in user study. Moreover, it brings a novel and interactive experience to professional layout design processes.


title: Cost-aware Defense for Parallel Server Systems against Reliability and Security Failures

abstract: Parallel server systems in transportation, manufacturing, and computing heavily rely on dynamic routing using connected cyber components for computation and communication. Yet, these components remain vulnerable to random malfunctions and malicious attacks, motivating the need for fault-tolerant dynamic routing that are both traffic-stabilizing and cost-efficient. In this paper, we consider a parallel server system with dynamic routing subject to reliability and stability failures. For the reliability setting, we consider an infinite-horizon Markov decision process where the system operator strategically activates protection mechanism upon each job arrival based on traffic state observations. We prove an optimal deterministic threshold protecting policy exists based on dynamic programming recursion of the HJB equation. For the security setting, we extend the model to an infinite-horizon stochastic game where the attacker strategically manipulates routing assignment. We show that both players follow a threshold strategy at every Markov perfect equilibrium. For both failure settings, we also analyze the stability of the traffic queues under control. Finally, we develop approximate dynamic programming algorithms to compute the optimal/equilibrium policies, supplemented with numerical examples and experiments for validation and illustration.


title: Quantum Topology Optimization via Quantum Annealing

abstract: We present a quantum annealing-based solution method for topology optimization (TO). In particular, we consider TO in a more general setting, i.e., applied to structures of continuum domains where designs are represented as distributed functions, referred to as continuum TO problems. According to the problem's properties and structure, we formulate appropriate sub-problems that can be solved on an annealing-based quantum computer. The methodology established can effectively tackle continuum TO problems formulated as mixed-integer nonlinear programs. To maintain the resulting sub-problems small enough to be solved on quantum computers currently accessible with small numbers of quits and limited connectivity, we further develop a splitting approach that splits the problem into two parts: the first part can be efficiently solved on classical computers, and the second part with a reduced number of variables is solved on a quantum computer. By such, a practical continuum TO problem of varying scales can be handled on the D-Wave quantum annealer. More specifically, we concern the minimum compliance, a canonical TO problem that seeks an optimal distribution of materials to minimize the compliance with desired material usage. The superior performance of the developed methodology is assessed and compared with the state-of-the-art heuristic classical methods, in terms of both solution quality and computational efficiency. The present work hence provides a promising new avenue of applying quantum computing to practical designs of topology for various applications.


title: On classical simulation algorithms for noisy Boson Sampling

abstract: We present a classical algorithm that approximately samples from the output distribution of certain noisy Boson Sampling experiments. This algorithm is inspired by a recent result of Aharonov, Gao, Landau, Liu and Vazirani and makes use of an observation originally due to Kalai and Kindler that the output probability of Boson Sampling experiments with a Gaussian noise model can be approximated by sparse low-degree polynomials. This observation alone does not suffice for classical sampling, because its marginal probabilities might not be approximated by sparse low-degree polynomials, and furthermore, the approximated probabilities might be negative. We solve this problem by employing the first quantization representation to give an algorithm for computing the marginal probabilities of these experiments. We prove that when the overall noise rate is constant, the algorithm runs in time quasi-polynomial in the number of input photons $N$ and accuracy. When the overall noise rate scales as $1-x_1^\gamma$ for constant $x_1$ and $\gamma=\Omega(\log N)$, the running time becomes polynomial. Furthermore, we study noisy Boson Sampling with practically relevant noise models such as partial distinguishability and photon loss. We show that the same technique does not immediately apply in these settings, leaving open the possibility of a scalable demonstration of noisy quantum advantage for these noise models in certain parameter regimes.


title: Singular integrals with product kernels associated with mixed homogeneities and Hardy spaces

abstract: This paper is motivated by Phong and Stein's paper on non-standard singular integrals with mixed homogeneities. Our purpose is to study these new non-standard convolution singular integrals and establish the boundedness of these singular integrals on the Hardy spaces.


title: Variations of star selection principles on Hyperspaces

abstract: In this paper we define some combinatorial principles to characterize spaces $X$ whose hyperspace satisfies some variation of some classical star selection principle. Specifically, the variations characterized are the selective and absolute versions of the star selection principles for the Menger and Rothberger cases; also, the hyperspaces considered in these characterizations are $CL(X)$, $\mathbb{K}(X)$, $\mathbb{F}(X)$ and $\mathbb{CS}(X)$ in both cases, endowed with either the Fell topology or the Vietoris topology.


title: Learning Informative Representation for Fairness-aware Multivariate Time-series Forecasting: A Group-based Perspective

abstract: Performance unfairness among variables widely exists in multivariate time series (MTS) forecasting models since such models may attend/bias to certain (advantaged) variables. Addressing this unfairness problem is important for equally attending to all variables and avoiding vulnerable model biases/risks. However, fair MTS forecasting is challenging and has been less studied in the literature. To bridge such significant gap, we formulate the fairness modeling problem as learning informative representations attending to both advantaged and disadvantaged variables. Accordingly, we propose a novel framework, named FairFor, for fairness-aware MTS forecasting. FairFor is based on adversarial learning to generate both group-independent and group-relevant representations for the downstream forecasting. The framework first leverages a spectral relaxation of the K-means objective to infer variable correlations and thus to group variables. Then, it utilizes a filtering&fusion component to filter the group-relevant information and generate group-independent representations via orthogonality regularization. The group-independent and group-relevant representations form highly informative representations, facilitating to sharing knowledge from advantaged variables to disadvantaged variables to guarantee fairness. Extensive experiments on four public datasets demonstrate the effectiveness of our proposed FairFor for fair forecasting and significant performance improvement.


abstract: An even lattice $M$ of signature $(n,2)$ is called $2$-reflective if there is a non-constant modular form for the orthogonal group of $M$ which vanishes only on quadratic divisors orthogonal to $2$-roots of $M$. In [Amer. J. Math. 2017] Shouhei Ma proved that there are only finitely many $2$-reflective lattices of signature $(n,2)$ with $n\geq 7$. In this paper we extend the finiteness result of Ma to $n\geq 5$ and show that there are exactly forty-two $2$-reflective lattices of signature $(n,2)$ with $n\geq 8$.


title: Behavior under magnetic field of resonance at the edge of the upper Hubbard band in 1T-TaS2

abstract: Recent theoretical investigations of quantum spin liquids have described phenomenology amenable to experimental observation using scanning tunneling microscopy. This includes characteristic resonances found at the edge of the upper Hubbard band of the host Mott insulator, that under certain conditions shift into the Mott gap under external magnetic field [W.-Y. He and P. A. Lee, arXiv:2212.08767]. In light of this we report scanning tunneling microscopy observations, in samples of the quantum spin liquid candidate 1T-TaS2, of a conductance peak at the upper Hubbard band edge and its magnetic field dependent behavior. These observations potentially represent evidence for the existence of a quantum spin liquid in 1T TaS2. We also observe samples in which such field dependence is absent, but with no observed correlate for the presence or absence of field dependence. This suggests one or more material properties controlling electronic behavior that are yet to be understood, and should help to motivate renewed investigation of the microscopic degrees of freedom in play in 1T-TaS2, as well as the possible realization of a quantum spin liquid phase.


title: Goal-Image Conditioned Dynamic Cable Manipulation through Bayesian Inference and Multi-Objective Black-Box Optimization

abstract: To perform dynamic cable manipulation to realize the configuration specified by a target image, we formulate dynamic cable manipulation as a stochastic forward model. Then, we propose a method to handle uncertainty by maximizing the expectation, which also considers estimation errors of the trained model. To avoid issues like multiple local minima and requirement of differentiability by gradient-based methods, we propose using a black-box optimization (BBO) to optimize joint angles to realize a goal image. Among BBO, we use the Tree-structured Parzen Estimator (TPE), a type of Bayesian optimization. By incorporating constraints into the TPE, the optimized joint angles are constrained within the range of motion. Since TPE is population-based, it is better able to detect multiple feasible configurations using the estimated inverse model. We evaluated image similarity between the target and cable images captured by executing the robot using optimal transport distance. The results show that the proposed method improves accuracy compared to conventional gradient-based approaches and methods that use deterministic models that do not consider uncertainty.


title: Rational curves in a quadric threefold via an $\text{SL}(2,\mathbb{C})$-representation

abstract: In this paper, we regard the smooth quadric threefold $Q_{3}$ as Lagrangian Grassmannian and search for fixed rational curves of low degree in $Q_{3}$ with respect to a torus action, which is the maximal subgroup of the special linear group $\text{SL}(2,\mathbb{C})$. Most of them are confirmations of very well-known facts. If the degree of a rational curve is $3$, it is confirmed using the Lagrangian's geometric properties that the moduli space of twisted cubic curves in $Q_3$ has a specific projective bundle structure. From this, we can immediately obtain the cohomology ring of the moduli space.


title: Occupation time fluctuations of an age-dependent critical binary branching particle system

abstract: We study the limit fluctuations of the rescaled occupation time process of a branching particle system in $\mathbb{R}^d$, where the particles are subject to symmetric $\alpha$-stable migration ($0<\alpha\leq2$), critical binary branching, and general non-lattice lifetime distribution. We focus on two different regimes: lifetime distributions having finite expectation, and Pareto-type lifetime distributions, i.e. distributions belonging to the normal domain of attraction of a $\gamma$-stable law with $\gamma\in(0,1)$. In the latter case we show that, for dimensions $\alpha\gamma<d<\alpha(1+\gamma)$, the rescaled occupation time fluctuations converge weakly to a centered Gaussian process whose covariance function is explicitly calculated, and we call it {\em weighted sub-fractional Brownian motion.} Moreover, in the case of lifetimes with finite mean, we show that for $\alpha<d<2\alpha$ the fluctuation limit turns out to be the same as in the case of exponentially distributed lifetimes studied by Bojdecki et al. [7,8,9]. We also investigate the maximal parameter range allowing existence of the weighted sub-fractional Brownian motion and provide some of its fundamental properties, such as path continuity, long-range dependence, self-similarity and the lack of Markov property.


title: Hide-and-Seek Game with Capacitated Locations and Imperfect Detection

abstract: We consider a variant of the hide-and-seek game in which a seeker inspects multiple hiding locations to find multiple items hidden by a hider. Each hiding location has a maximum hiding capacity and a probability of detecting its hidden items when an inspection by the seeker takes place. The objective of the seeker (resp. hider) is to minimize (resp. maximize) the expected number of undetected items. This model is motivated by strategic inspection problems, where a security agency is tasked with coordinating multiple inspection resources to detect and seize illegal commodities hidden by a criminal organization. To solve this large-scale zero-sum game, we leverage its structure and show that its mixed strategies Nash equilibria can be characterized using their unidimensional marginal distributions, which are Nash equilibria of a lower dimensional continuous zero-sum game. This leads to a two-step approach for efficiently solving our hide-and-seek game: First, we analytically solve the continuous game and compute the equilibrium marginal distributions. Second, we derive a combinatorial algorithm to coordinate the players' resources and compute equilibrium mixed strategies that satisfy the marginal distributions. We show that this solution approach computes a Nash equilibrium of the hide-and-seek game in quadratic time with linear support. Our analysis reveals a complex interplay between the game parameters and allows us to evaluate their impact on the players' behaviors in equilibrium and the criticality of each location.


title: Feasibility and Transferability of Transfer Learning: A Mathematical Framework

abstract: Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. Despite its numerous empirical successes, theoretical analysis for transfer learning is limited. In this paper we build for the first time, to the best of our knowledge, a mathematical framework for the general procedure of transfer learning. Our unique reformulation of transfer learning as an optimization problem allows for the first time, analysis of its feasibility. Additionally, we propose a novel concept of transfer risk to evaluate transferability of transfer learning. Our numerical studies using the Office-31 dataset demonstrate the potential and benefits of incorporating transfer risk in the evaluation of transfer learning performance.


title: Machine-guided Design of Oxidation Resistant Superconductors for Quantum Information Applications

abstract: Decoherence in superconducting qubits has long been attributed to two level systems arising from the surfaces and interfaces present in real devices. A recent significant step in reducing decoherence was the replacement of superconducting niobium by superconducting tantalum, resulting in a tripling of transmon qubit lifetimes (T1). One of these surface variables, the identity, thickness, and quality of the native surface oxide, is thought to play a major role as tantalum only has one oxide whereas niobium has several. Here we report the development of a thermodynamic metric to rank materials based on their potential to form a well-defined, thin, surface oxide. We first compute this metric for known binary and ternary metal alloys using data available from Materials Project, and experimentally validate the strengths and limits of this metric through preparation and controlled oxidation of 8 known metal alloys. Then we train a convolutional neural network to predict the value of this metric from atomic composition and atomic properties. This allows us to compute the metric for materials that are not present in materials project, including a large selection of known superconductors, and, when combined with Tc, allow us to identify new candidate superconductors for quantum information science (QISE) applications. We test the oxidation resistance of a pair of these predictions experimentally. Our results are expected to lay the foundation for tailored and rapid selection of improved superconductors for QISE.


title: Targeted Attacks on Timeseries Forecasting

abstract: Real-world deep learning models developed for Time Series Forecasting are used in several critical applications ranging from medical devices to the security domain. Many previous works have shown how deep learning models are prone to adversarial attacks and studied their vulnerabilities. However, the vulnerabilities of time series models for forecasting due to adversarial inputs are not extensively explored. While the attack on a forecasting model might aim to deteriorate the performance of the model, it is more effective, if the attack is focused on a specific impact on the model's output. In this paper, we propose a novel formulation of Directional, Amplitudinal, and Temporal targeted adversarial attacks on time series forecasting models. These targeted attacks create a specific impact on the amplitude and direction of the output prediction. We use the existing adversarial attack techniques from the computer vision domain and adapt them for time series. Additionally, we propose a modified version of the Auto Projected Gradient Descent attack for targeted attacks. We examine the impact of the proposed targeted attacks versus untargeted attacks. We use KS-Tests to statistically demonstrate the impact of the attack. Our experimental results show how targeted attacks on time series models are viable and are more powerful in terms of statistical similarity. It is, hence difficult to detect through statistical methods. We believe that this work opens a new paradigm in the time series forecasting domain and represents an important consideration for developing better defenses.


title: Fast and accurate determination of the curvature-corrected field emission current

abstract: The curvature-corrected field emission current density, obtained by linearizing at or below the Fermi energy, is investigated. Two special cases, corresponding to the peak of the normal energy distribution and the mean normal energy, are considered. It is found that the current density evaluated using the mean normal energy results in errors in the net emission current below 3% for apex radius of curvature, $R_a \geq 5$nm and for apex fields $E_a$ in the range $3-10$ V/nm for an emitter having work-function $\phi = 4.5$eV. An analytical expression for the net field emission current is also obtained for locally parabolic tips using the generalized cosine law. The errors are found to be below 6% for $R_a \geq 5$nm over an identical range of apex field strengths. The benchmark current is obtained by numerically integrating the current density over the emitter surface and the current density itself computed by integrating over the energy states using the exact Gamow factor and the Kemble form for the WKB transmission coefficient. The analytical expression results in a remarkable speed-up in the computation of the net emission current and is especially useful for large area field emitters having tens of thousands of emission sites.

categories: physics.app-ph cond-mat.mes-hall physics.acc-ph physics.space-ph


title: Adapting Step-size: A Unified Perspective to Analyze and Improve Gradient-based Methods for Adversarial Attacks

abstract: Learning adversarial examples can be formulated as an optimization problem of maximizing the loss function with some box-constraints. However, for solving this induced optimization problem, the state-of-the-art gradient-based methods such as FGSM, I-FGSM and MI-FGSM look different from their original methods especially in updating the direction, which makes it difficult to understand them and then leaves some theoretical issues to be addressed in viewpoint of optimization. In this paper, from the perspective of adapting step-size, we provide a unified theoretical interpretation of these gradient-based adversarial learning methods. We show that each of these algorithms is in fact a specific reformulation of their original gradient methods but using the step-size rules with only current gradient information. Motivated by such analysis, we present a broad class of adaptive gradient-based algorithms based on the regular gradient methods, in which the step-size strategy utilizing information of the accumulated gradients is integrated. Such adaptive step-size strategies directly normalize the scale of the gradients rather than use some empirical operations. The important benefit is that convergence for the iterative algorithms is guaranteed and then the whole optimization process can be stabilized. The experiments demonstrate that our AdaI-FGM consistently outperforms I-FGSM and AdaMI-FGM remains competitive with MI-FGSM for black-box attacks.


title: Safe Posterior Sampling for Constrained MDPs with Bounded Constraint Violation

abstract: Constrained Markov decision processes (CMDPs) model scenarios of sequential decision making with multiple objectives that are increasingly important in many applications. However, the model is often unknown and must be learned online while still ensuring the constraint is met, or at least the violation is bounded with time. Some recent papers have made progress on this very challenging problem but either need unsatisfactory assumptions such as knowledge of a safe policy, or have high cumulative regret. We propose the Safe PSRL (posterior sampling-based RL) algorithm that does not need such assumptions and yet performs very well, both in terms of theoretical regret bounds as well as empirically. The algorithm achieves an efficient tradeoff between exploration and exploitation by use of the posterior sampling principle, and provably suffers only bounded constraint violation by leveraging the idea of pessimism. Our approach is based on a primal-dual approach. We establish a sub-linear $\tilde{\mathcal{ O}}\left(H^{2.5} \sqrt{|\mathcal{S}|^2 |\mathcal{A}| K} \right)$ upper bound on the Bayesian reward objective regret along with a bounded, i.e., $\tilde{\mathcal{O}}\left(1\right)$ constraint violation regret over $K$ episodes for an $|\mathcal{S}|$-state, $|\mathcal{A}|$-action and horizon $H$ CMDP.


title: No-signaling in Nonlinear Extensions of Quantum Mechanics

abstract: Devising a nonlinear extension of quantum mechanics is nontrivial because unphysical features such as supraluminal communication (signaling) are to be excluded. In this Letter, we show that the steepest entropy ascent formalism is a viable no-signaling extension belonging to a broader class of no-signaling nonlinear evolution equations for which the local evolution of a subsystem is not necessarily bound to depend only on its reduced state. We prove that, in addition to the local reduced density operator, there is a broad class of local operators called `local perceptions', which are insensitive to unitary operations localized within other non-interacting systems.


title: X-ray studies of the pulsar PSR J1420-6048 and its TeV pulsar wind nebula in the Kookaburra region

abstract: We present a detailed analysis of broadband X-ray observations of the pulsar PSR J1420-6048 and its wind nebula (PWN) in the Kookaburra region with Chandra, XMM-Newton, and NuSTAR. Using the archival XMM-Newton and new NuSTAR data, we detected 68 ms pulsations of the pulsar and characterized its X-ray pulse profile which exhibits a sharp spike and a broad bump separated by ~0.5 in phase. A high-resolution Chandra image revealed a complex morphology of the PWN: a torus-jet structure, a few knots around the torus, one long (~7') and two short tails extending in the northwest direction, and a bright diffuse emission region to the south. Spatially integrated Chandra and NuSTAR spectra of the PWN out to 2.5' are well described by a power law model with a photon index ${\Gamma} {\approx}$ 2. A spatially resolved spectroscopic study, as well as NuSTAR radial profiles of the 3--7 keV and 7--20 keV brightness, showed a hint of spectral softening with increasing distance from the pulsar. A multi-wavelength spectral energy distribution (SED) of the source was then obtained by supplementing our X-ray measurements with published radio, Fermi-LAT, and H.E.S.S. data. The SED and radial variations of the X-ray spectrum were fit with a leptonic multi-zone emission model. Our detailed study of the PWN may be suggestive of (1) particle transport dominated by advection, (2) a low magnetic-field strength (B ~ 5${\mu}$G), and (3) electron acceleration to ~PeV energies.


title: Observation of highly anisotropic bulk dispersion and spin-polarized topological surface states in CoTe2

abstract: We present CoTe2 as a new type-II Dirac semimetal supporting Lorentz symmetry violating Dirac fermions in the vicinity of the Fermi energy. By combining first principle ab-initio calculations with experimental angle-resolved photo-emission spectroscopy results, we show the CoTe2 hosts a pair of type-II Dirac fermions around 90 meV above the Fermi energy. In addition to the bulk Dirac fermions, we find several topological band inversions in bulk CoTe2, which gives rise to a ladder of spin-polarized surface states over a wide range of energies. In contrast to the surface states which typically display Rashba-type in-plane spin splitting, we find that CoTe2 hosts novel out-of-plane spin polarization as well. Our work establishes CoTe2 as a potential candidate for the exploration of Dirac fermiology and applications in spintronic devices, infrared plasmonics, and ultrafast optoelectronics.


title: Harmonizing Flows: Unsupervised MR harmonization based on normalizing flows

abstract: In this paper, we propose an unsupervised framework based on normalizing flows that harmonizes MR images to mimic the distribution of the source domain. The proposed framework consists of three steps. First, a shallow harmonizer network is trained to recover images of the source domain from their augmented versions. A normalizing flow network is then trained to learn the distribution of the source domain. Finally, at test time, a harmonizer network is modified so that the output images match the source domain's distribution learned by the normalizing flow model. Our unsupervised, source-free and task-independent approach is evaluated on cross-domain brain MRI segmentation using data from four different sites. Results demonstrate its superior performance compared to existing methods.


title: Cuspidal components of Siegel modular forms for large discrete series representations of $\mathrm{Sp}_4(\mathbb{R})$

abstract: In this paper, we consider automorphic forms on $\mathrm{Sp}_4(\mathbb{A}_\mathbb{Q})$ which generate large discrete series representations of $\mathrm{Sp}_4(\mathbb{R})$ as $(\mathfrak{sp}_4(\mathbb{R}),K_\infty)$-modules. We determine the cuspidal components and the structure of the space of such automorphic forms.


title: Robust Transformer with Locality Inductive Bias and Feature Normalization

abstract: Vision transformers have been demonstrated to yield state-of-the-art results on a variety of computer vision tasks using attention-based networks. However, research works in transformers mostly do not investigate robustness/accuracy trade-off, and they still struggle to handle adversarial perturbations. In this paper, we explore the robustness of vision transformers against adversarial perturbations and try to enhance their robustness/accuracy trade-off in white box attack settings. To this end, we propose Locality iN Locality (LNL) transformer model. We prove that the locality introduction to LNL contributes to the robustness performance since it aggregates local information such as lines, edges, shapes, and even objects. In addition, to further improve the robustness performance, we encourage LNL to extract training signal from the moments (a.k.a., mean and standard deviation) and the normalized features. We validate the effectiveness and generality of LNL by achieving state-of-the-art results in terms of accuracy and robustness metrics on German Traffic Sign Recognition Benchmark (GTSRB) and Canadian Institute for Advanced Research (CIFAR-10). More specifically, for traffic sign classification, the proposed LNL yields gains of 1.1% and ~35% in terms of clean and robustness accuracy compared to the state-of-the-art studies.


title: Heat and Worker Health

abstract: Extreme heat negatively impacts cognition, learning, and task performance. With increasing global temperatures, workers may therefore be at increased risk of work-related injuries and illness. This study estimates the effects of temperature on worker health using records spanning 1985-2020 from an Australian mandatory insurance scheme. High temperatures are found to cause significantly more claims, particularly among manual workers in outdoor-based industries. These adverse effects have not diminished across time, with the largest effect observed for the 2015-2020 period, indicating increasing vulnerability to heat. Within occupations, the workers most adversely affected by heat are female, older-aged and higher-earning. Finally, results from firm-level panel analyses show that the percentage increase in claims on hot days is largest at "safer" firms.


title: Bayesian neural network for plasma equilibria in the Korea Superconducting Tokamak Advanced Research

abstract: Fusion-graded plasmas are one of the physically complex systems, resulting in continuous establishment of plasma theories for unclarified physical phenomena in order to thoroughly control nuclear fusion reactors. Deep learning has drawn vast attention to this field of controlled fusion plasma to link physical phenomena with control-relevant parameters without a deepened understanding about plasma theories. Albeit, quantifying the uncertainty of deep learning models has been constantly requested due to their fundamental shortage of physical understanding. Thus, a concept of a reliable deep learning model to be able to present their probability distributions is raised as well as a method to inculcate physical theories in the model is also concerned.


title: Conformal inference is (almost) free for neural networks trained with early stopping

abstract: Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relatively accurate predictions, but they generally still lack precise statistical guarantees unless they are further calibrated using independent hold-out data. This paper addresses the above limitation with conformalized early stopping: a novel method that combines early stopping with conformal calibration while efficiently recycling the same hold-out data. This leads to models that are both accurate and able to provide exact predictive inferences without multiple data splits nor overly conservative adjustments. Practical implementations are developed for different learning tasks -- outlier detection, multi-class classification, regression -- and their competitive performance is demonstrated on real data.