title: Big Bang Nucleosynthesis

abstract: As the early universe expands and cools the rates of the weak interactions that keep neutrinos in thermal equilibrium with the matter and the related rates of the reactions that inter-convert neutrons and protons decrease. Eventually, these rates fall below the expansion rate -- they freeze out. Likewise, the rates of the strong and electromagnetic nuclear reactions that build up and tear down nuclei, though fast enough to maintain equilibrium early on, slow down and ultimately lead to freeze out. Together these freeze out processes comprise the epoch of Big Bang Nucleosynthesis (BBN). The relics emerging from this early time include the light element abundances, for example of helium and deuterium, and a background of decoupled neutrinos, a "C$\nu$B" , roughly analogous to the Cosmic Microwave Background, the CMB. These fossil relics encode the history of the physics operating in the early universe. Consequently, BBN has emerged as a key tool for constraining new, beyond-standard-model (BSM) physics. BBN may become an even finer probe of BSM physics, given the anticipated higher precision in measurements of the primordial abundances of deuterium and helium afforded by the advent of large optical telescopes and Stage-4 CMB experiments. The latter experiments will also provide higher precision determinations of $N_{\rm eff}$, a measure of the relativistic energy density at the photon decoupling epoch and, hence, an important probe of the C$\nu$B.


title: Molecular gas properties in young stellar clusters with a suppressed star cluster wind

abstract: In compact and dense star-forming clouds a global star cluster wind could be suppressed. In this case the stellar feedback is unable to expel the leftover gas from the cluster. Young massive stars remain embedded into a dense residual gas and stir it moving in the gravitational well of the system. Here we present a self-consistent model for the molecular gas distribution in such young, enshrouded stellar clusters. It is assumed that the cloud collapse terminates and the star formation ceases when a balance between the turbulent pressure and gravity and between the turbulent energy dissipation and regeneration rates is established. These conditions result in an equation that determines the residual gas density distribution that, in turn, allows one to determine the other characteristics of the leftover gas and the star formation efficiency. It is shown that model predictions are in good agreement with several observationally determined properties of cloud D1 in nearby dwarf spheroidal galaxy NGC 5253 and its embedded cluster.


title: Arbitrarily polarized and unidirectional emission from thermal metasurfaces

abstract: Thermal emission from a hot body is ubiquitous, yet its properties remain inherently challenging to control due to its incoherent nature. Recent advances in thermal emission manipulation have been unveiling exciting phenomena and new opportunities for applications. In particular, judiciously patterned nanoscale features over their surface have been shown to channel emission sources into partially coherent beams with tailored directionality and frequency selectivity. Yet, more sophisticated forms of control, such as spin-selective and unidirectional thermal emission have remained elusive. Here, we experimentally demonstrate single-layer metasurfaces emitting unidirectional, narrowband thermal light in the infrared with arbitrary polarization states - an operation enabled by photonic bound states in the continuum locally tailored by a geometric phase controlling the temporal and spatial coherence of emitted light. The demonstrated platform paves the way to a compactification paradigm for metasurface optics, in which thermal emission or photoluminescence can feed arbitrarily patterned beams without the need of external coherent sources.


title: A Kriging Metamodel with Adaptive Sampling for Seismic Evaluation of Podium Buildings

abstract: In this paper, nonlinear time-history dynamic analyses of selected earthquake ground motions are conducted on designated wood-frame podium buildings and the resulting inter-story drifts are analyzed. We aim to construct a reliable region where performance-based seismic design criteria are met, such that a two-step analysis procedure can be used with high confidence. We develop a kriging metamodel with tailored adaptive sampling methods to achieve this goal in a computationally efficient manner. The input variables we consider are the normalized stiffness ratio and the normalized mass ratio of the podium building. We took a six-story wood frame built upon a one-story concrete podium as a case study for our methodology, where our results indicate that the two-step analysis procedure may be used with high confidence if its normalized stiffness ratio is at least 38 and its normalized mass ratio is between 0.5 and 1.5.


title: Presence of informal language, such as emoticons, hashtags, and slang, impact the performance of sentiment analysis models on social media text?

abstract: This study aimed to investigate the influence of the presence of informal language, such as emoticons and slang, on the performance of sentiment analysis models applied to social media text. A convolutional neural network (CNN) model was developed and trained on three datasets: a sarcasm dataset, a sentiment dataset, and an emoticon dataset. The model architecture was held constant for all experiments and the model was trained on 80% of the data and tested on 20%. The results revealed that the model achieved an accuracy of 96.47% on the sarcasm dataset, with the lowest accuracy for class 1. On the sentiment dataset, the model achieved an accuracy of 95.28%. The amalgamation of sarcasm and sentiment datasets improved the accuracy of the model to 95.1%, and the addition of emoticon dataset has a slight positive impact on the accuracy of the model to 95.37%. The study suggests that the presence of informal language has a restricted impact on the performance of sentiment analysis models applied to social media text. However, the inclusion of emoticon data to the model can enhance the accuracy slightly.


title: Ornstein-Uhlenbeck process and generalizations: particle's dynamics under comb constraints and stochastic resetting

abstract: The Ornstein-Uhlenbeck process is interpreted as Brownian motion in a harmonic potential. This Gaussian Markov process has a bounded variance and admits a stationary probability distribution, in contrast to the standard Brownian motion. It also tends to a drift towards its mean function, and such a process is called mean-reverting. Two examples of the generalized Ornstein-Uhlenbeck process are considered. In the first one, we study the Ornstein-Uhlenbeck process on a comb model, as an example of the harmonically bounded random motion in the topologically constrained geometry. The main dynamical characteristics (as the first and the second moments) and the probability density function are studied in the framework of both the Langevin stochastic equation and the Fokker-Planck equation. The second example is devoted to the study of the effects of stochastic resetting on the Ornstein-Uhlenbeck process, including stochastic resetting in the comb geometry. Here, the non-equilibrium stationary state is the main question in task, where the two divergent forces, namely the resetting and the drift towards the mean, lead to compelling results both in the case of the Ornstein-Uhlenbeck process with resetting and its generalization on the two dimensional comb structure.


title: Composing Task Knowledge with Modular Successor Feature Approximators

abstract: Recently, the Successor Features and Generalized Policy Improvement (SF&GPI) framework has been proposed as a method for learning, composing, and transferring predictive knowledge and behavior. SF&GPI works by having an agent learn predictive representations (SFs) that can be combined for transfer to new tasks with GPI. However, to be effective this approach requires state features that are useful to predict, and these state-features are typically hand-designed. In this work, we present a novel neural network architecture, "Modular Successor Feature Approximators" (MSFA), where modules both discover what is useful to predict, and learn their own predictive representations. We show that MSFA is able to better generalize compared to baseline architectures for learning SFs and modular architectures


title: Have underground radiation measurements refuted the Orch OR theory?

abstract: In [1] it is claimed that, based on radiation emission measurements described in [2], a certain "variant" of the Orch OR theory has been refuted. I agree with this claim. However, the significance of this result for Orch OR per se is unclear. After all, the refuted "variant" was never advocated by anyone, and it contradicts the views of Hameroff and Penrose (hereafter: HP) who invented Orch OR [3]. My aim is to get clear on this situation. I argue that it is indeed reasonable to speak of "variants" here. Orch OR is not a complete model of reality but a work in progress. At its core, it claims that wavefunction collapse is a real physical event that has something to do with gravity ("OR") and that consciousness depends on orchestrated collapses in microtubules ("Orch"). There are many ways one could make these base ideas precise hence many "variants". Furthermore, the ways that HP aim to make these ideas precise are radical and incomplete. If they don't work out, Orch OR will need to fall back on another variant. Thus, I believe the significance of [1-2] for Orch OR is that it cuts out a small class of possible variants and leaves behind questions and challenges for the rest, including the variant preferred by HP.


title: MQAG: Multiple-choice Question Answering and Generation for Assessing Information Consistency in Summarization

abstract: State-of-the-art summarization systems can generate highly fluent summaries. These summaries, however, may contain factual inconsistencies and/or information not present in the source. Hence, an important component of assessing the quality of summaries is to determine whether there is information consistency between the source and the summary. Existing approaches are typically based on lexical matching or representation-based methods. In this work, we introduce an alternative scheme based on standard information-theoretic measures in which the information present in the source and summary is directly compared. We propose a Multiple-choice Question Answering and Generation framework, MQAG, which approximates the information consistency by computing the expected statistical distance between summary and source answer distributions over automatically generated multiple-choice questions. This approach exploits multiple-choice answer probabilities, as predicted answer distributions can be compared. We conduct experiments on four summary evaluation datasets: QAG-CNNDM/XSum, XSum-Hallucination, Podcast Assessment, and SummEval. Experiments show that MQAG, using models trained on SQuAD or RACE, outperforms existing evaluation methods on the majority of tasks.


title: Correcting models with long-range electron interaction using generalized cusp conditions

abstract: Sources of energy errors resulting from the replacement of the physical Coulomb interaction by its long-range $\mathrm{erfc}(\mu r)/r$ approximation are explored. It is demonstrated that the results can be dramatically improved and the range of $\mu$ giving energies within chemical accuracy limits significantly extended, if the generalized cusp conditions are used to represent the wave function at small $r$. The numerical results for two-electron harmonium are presented and discussed.


title: On the Lipschitz Constant of Deep Networks and Double Descent

abstract: Existing bounds on the generalization error of deep networks assume some form of smooth or bounded dependence on the input variable, falling short of investigating the mechanisms controlling such factors in practice. In this work, we present an extensive experimental study of the empirical Lipschitz constant of deep networks undergoing double descent, and highlight non-monotonic trends strongly correlating with the test error. Building a connection between parameter-space and input-space gradients for SGD around a critical point, we isolate two important factors -- namely loss landscape curvature and distance of parameters from initialization -- respectively controlling optimization dynamics around a critical point and bounding model function complexity, even beyond the training data. Our study presents novels insights on implicit regularization via overparameterization, and effective model complexity for networks trained in practice.


title: Wightman fields for two-dimensional conformal field theories with pointed representation category

abstract: Two-dimensional full conformal field theories have been studied in various mathematical frameworks, from algebraic, operator-algebraic to categorical. In this work, we focus our attention on theories with chiral components having pointed braided tensor representation subcategories, namely having automorphisms whose equivalence classes necessarily form an abelian group. For such theories, we exhibit the explicit Hilbert space structure and construct primary fields as Wightman fields for the two-dimensional full theory. Given a finite collection of chiral components with automorphism categories with trivial total braiding, we also construct a local extension of their tensor product as a chiral component. We clarify the relations with the Longo-Rehren construction, and illustrate these results with concrete examples including the U(1)-current.


title: Controlled synthetic chirality in macroscopic assemblies of carbon nanotubes

abstract: There is an emerging recognition that successful utilization of chiral degrees of freedom can bring new scientific and technological opportunities to diverse research areas. Hence, methods are being sought for creating artificial matter with controllable chirality in an uncomplicated and reproducible manner. Here, we report the development of two straightforward methods for fabricating wafer-scale chiral architectures of ordered carbon nanotubes (CNTs) with tunable and giant circular dichroism (CD). Both methods employ simple approaches, (i) mechanical rotation and (ii) twist-stacking, based on controlled vacuum filtration and do not involve any sophisticated nanofabrication processes. We used a racemic mixture of CNTs as the starting material, so the intrinsic chirality of chiral CNTs is not responsible for the observed chirality. In particular, by controlling the stacking angle and handedness in (ii), we were able to maximize the CD response and achieve a record-high deep-ultraviolet ellipticity of 40 $\pm$ 1 mdeg/nm. Our theoretical simulations using the transfer matrix method reproduce the salient features of the experimentally observed CD spectra and further predict that a film of twist-stacked CNTs with an optimized thickness will exhibit an ellipticity as high as 150 mdeg/nm. The created wafer-scale objects represent a new class of synthetic chiral matter consisting of ordered quantum wires whose macroscopic properties are governed by nanoscopic electronic signatures such as van Hove singularities. These artificial structures with engineered chirality will not only provide playgrounds for uncovering new chiral phenomena but also open up new opportunities for developing high-performance chiral photonic and optoelectronic devices.


title: Accelerating Graph Analytics on a Reconfigurable Architecture with a Data-Indirect Prefetcher

abstract: The irregular nature of memory accesses of graph workloads makes their performance poor on modern computing platforms. On manycore reconfigurable architectures (MRAs), in particular, even state-of-the-art graph prefetchers do not work well (only 3% speedup), since they are designed for traditional CPUs. This is because caches in MRAs are typically not large enough to host a large quantity of prefetched data, and many employs shared caches that such prefetchers simply do not support. This paper studies the design of a data prefetcher for an MRA called Transmuter. The prefetcher is built on top of Prodigy, the current best-performing data prefetcher for CPUs. The key design elements that adapt the prefetcher to the MRA include fused prefetcher status handling registers and a prefetch handshake protocol to support run-time reconfiguration, in addition, a redesign of the cache structure in Transmuter. An evaluation of popular graph workloads shows that synergistic integration of these architectures outperforms a baseline without prefetcher by 1.27x on average and by as much as 2.72x on some workloads.


title: Adapting Neural Link Predictors for Data-Efficient Complex Query Answering

abstract: Answering complex queries on incomplete knowledge graphs is a challenging task where a model needs to answer complex logical queries in the presence of missing knowledge. Prior work in the literature has proposed to address this problem by designing architectures trained end-to-end for the complex query answering task with a reasoning process that is hard to interpret while requiring data and resource-intensive training. Other lines of research have proposed re-using simple neural link predictors to answer complex queries, reducing the amount of training data by orders of magnitude while providing interpretable answers. The neural link predictor used in such approaches is not explicitly optimised for the complex query answering task, implying that its scores are not calibrated to interact together. We propose to address these problems via CQD$^{\mathcal{A}}$, a parameter-efficient score \emph{adaptation} model optimised to re-calibrate neural link prediction scores for the complex query answering task. While the neural link predictor is frozen, the adaptation component -- which only increases the number of model parameters by $0.03\%$ -- is trained on the downstream complex query answering task. Furthermore, the calibration component enables us to support reasoning over queries that include atomic negations, which was previously impossible with link predictors. In our experiments, CQD$^{\mathcal{A}}$ produces significantly more accurate results than current state-of-the-art methods, improving from $34.4$ to $35.1$ Mean Reciprocal Rank values averaged across all datasets and query types while using $\leq 30\%$ of the available training query types. We further show that CQD$^{\mathcal{A}}$ is data-efficient, achieving competitive results with only $1\%$ of the training complex queries, and robust in out-of-domain evaluations.


title: Progressive Prompts: Continual Learning for Language Models

abstract: We introduce Progressive Prompts - a simple and efficient approach for continual learning in language models. Our method allows forward transfer and resists catastrophic forgetting, without relying on data replay or a large number of task-specific parameters. Progressive Prompts learns a new soft prompt for each task and sequentially concatenates it with the previously learned prompts, while keeping the base model frozen. Experiments on standard continual learning benchmarks show that our approach outperforms state-of-the-art methods, with an improvement >20% in average test accuracy over the previous best-preforming method on T5 model. We also explore a more challenging continual learning setup with longer sequences of tasks and show that Progressive Prompts significantly outperforms prior methods.


title: Isoparametric functions and mean curvature in manifolds with Zermelo navigation

abstract: The generalized Zermelo navigation problem looks for the shortest time paths in an environment, modeled by a Finsler manifold (M,F), under the influence of wind or current, represented by a vector field W. The main objective of this paper is to investigate the relationship between the isoparametric functions on the manifold M with and without the presence of the vector field W. For the positive-definite cases, we also compare the mean curvatures in the manifold. Overall, we follow a coordinate-free approach.


title: Wind Tunnel Testing and Aerodynamic Characterization of a QuadPlane Uncrewed Aircraft System

abstract: Electric Vertical Takeoff and Landing (eVTOL) vehicles will open new opportunities in aviation. This paper describes the design and wind tunnel analysis of an eVTOL uncrewed aircraft system (UAS) prototype with a traditional aircraft wing, tail, and puller motor along with four vertical thrust pusher motors. Vehicle design and construction are summarized. Dynamic thrust from propulsion modules is experimentally determined at different airspeeds over a large sweep of propeller angles of attack. Wind tunnel tests with the vehicle prototype cover a suite of hover, transition and cruise flight conditions. Net aerodynamic forces and moments are distinctly computed and compared for plane, quadrotor and hybrid flight modes. Coefficient-based models are developed. Polynomial curve fits accurately capture observed data over all test configurations. To our knowledge, the presented wind tunnel experimental analysis for a multi-mode eVTOL platform is novel. Increased drag and reduced dynamic thrust likely due to flow interactions will be important to address in future designs.


title: Epitaxial growth, optical and electrical conductivity of the metallic pyrochlore Bi$_2$Ru$_2$O$_7$ on Y-stabilized ZrO$_2$ substrate

abstract: We report on the epitaxial growth, structural and electrical properties of metallic pyrochlore bismuth ruthenate heterostructures grown along both the [001] and [111] directions. Ordered pyrochlore thin films were obtained with highly oriented texture along the [001] and [111] crystallographic directions. Density functional theory calculations of the electronic band structure and density of states indicated that Bi$_2$Ru$_2$O$_7$ is semimetallic and that hybridization of the Ru 4$d$ and Bi 6$p$ orbitals via the anion network at the Fermi energy was responsible for the metallicity. Electrical conductivity measurements confirmed that the compound is weakly metallic in agreement with the reported conductivity for the stoichiometric bulk compound. The carrier concentration and mobility of the electrons compared favorably with previous reports on bulk material and indicate strong electron-electron interactions. The measured and computed optical conductivities were found to share coincident spectral features and confirm the electronic correlation. Comparison of the electrical and optical properties of the two distinct orientations indicates differences that cannot be attributed to differences in crystalline quality or dislocations and may indicate anisotropy in the electronic structure of Bi$_2$Ru$_2$O$_7$. This study will enable access to the kagome lattice arising naturally in the {111} planes of the pyrochlore B cation sublattice which may be used to uncover emergent topological properties.


title: Gradient Shaping: Enhancing Backdoor Attack Against Reverse Engineering

abstract: Most existing methods to detect backdoored machine learning (ML) models take one of the two approaches: trigger inversion (aka. reverse engineer) and weight analysis (aka. model diagnosis). In particular, the gradient-based trigger inversion is considered to be among the most effective backdoor detection techniques, as evidenced by the TrojAI competition, Trojan Detection Challenge and backdoorBench. However, little has been done to understand why this technique works so well and, more importantly, whether it raises the bar to the backdoor attack. In this paper, we report the first attempt to answer this question by analyzing the change rate of the backdoored model around its trigger-carrying inputs. Our study shows that existing attacks tend to inject the backdoor characterized by a low change rate around trigger-carrying inputs, which are easy to capture by gradient-based trigger inversion. In the meantime, we found that the low change rate is not necessary for a backdoor attack to succeed: we design a new attack enhancement called \textit{Gradient Shaping} (GRASP), which follows the opposite direction of adversarial training to reduce the change rate of a backdoored model with regard to the trigger, without undermining its backdoor effect. Also, we provide a theoretic analysis to explain the effectiveness of this new technique and the fundamental weakness of gradient-based trigger inversion. Finally, we perform both theoretical and experimental analysis, showing that the GRASP enhancement does not reduce the effectiveness of the stealthy attacks against the backdoor detection methods based on weight analysis, as well as other backdoor mitigation methods without using detection.


title: Hawking radiation inside a charged black hole

abstract: Here we analyze the Hawking radiation detected by an inertial observer in an arbitrary position in a Reissner-Nordstr\"om spacetime, with special emphasis on the asymptotic behavior of the Hawking spectrum as an observer approaches the inner or outer horizon. Two different methods are used to analyze the Hawking flux: first, we calculate an effective temperature quantifying the rate of exponential redshift experienced by an observer from an emitter's vacuum modes, which reproduces the Hawking effect provided the redshift is sufficiently adiabatic. Second, we compute the full Bogoliubov graybody spectrum observed in the three regimes where the wave equation can be solved analytically (at infinity and at the outer and inner horizons). We find that for an observer at the event horizon, the effective Hawking temperature is finite and becomes negative when $(Q/M)^2>8/9$, while at the inner horizon, the effective temperature is always negative and infinite in every direction the observer looks, coinciding with an ultraviolet-divergent spectrum.


title: Stabilizing a hydrogen-rich superconductor at 1 GPa by the charge-transfer modulated virtual high-pressure effect

abstract: Applying pressure around megabar is indispensable in the synthesis of high-temperature superconducting hydrides, such as SH$_3$ and LaH$_{10}$. Stabilizing the high-pressure phase of hydride around ambient condition is a severe challenge. Based on the density-functional theory calculations, we give the first example that the structure of hydride CaBH$_5$ predicted above 280 GPa, can maintain its dynamical stability with pressure down to 1 GPa, by modulating the charge transfer from metal atoms to hydrogen atoms via the replacement of Ca with alkali metal atoms e.g. Cs, in which the [BH$_5$]$^{2-}$ anion shrinks along $c$ axis and expands in the $ab$ plane, experiencing an anisotropic virtual high pressure. This mechanism, namely charge transfer modulated virtual high pressure effect, plays a vital role in enhancing the structural stability and leading to the reemergence of ambient-pressure-forbidden [BH$_5$]$^{2-}$ anion around 1 GPa in CsBH$_5$. Moreover, we find that CsBH$_5$ is a strongly coupled superconductor, with transition temperature as high as 98 K, well above the liquid-nitrogen temperature. Our findings provide a novel mechanism to reduce the critical pressure required by hydrogen-rich compound without changing its crystal structure, and also shed light on searching ambient-pressure high-temperature superconductivity in metal borohydrides.


title: Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data

abstract: Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such as label errors, under-representation, and outliers. In this paper, we propose a unified approach for identifying the problematic data by utilizing a largely ignored source of information: a relational structure of data in the feature-embedded space. To this end, we present scalable and effective algorithms for detecting label errors and outlier data based on the relational graph structure of data. We further introduce a visualization tool that provides contextual information of a data point in the feature-embedded space, serving as an effective tool for interactively diagnosing data. We evaluate the label error and outlier/out-of-distribution (OOD) detection performances of our approach on the large-scale image, speech, and language domain tasks, including ImageNet, ESC-50, and SST2. Our approach achieves state-of-the-art detection performance on all tasks considered and demonstrates its effectiveness in debugging large-scale real-world datasets across various domains. We release codes at https://github.com/snu-mllab/Neural-Relation-Graph.


title: Cross-Subject Deep Transfer Models for Evoked Potentials in Brain-Computer Interface

abstract: Brain Computer Interface (BCI) technologies have the potential to improve the lives of millions of people around the world, whether through assistive technologies or clinical diagnostic tools. Despite advancements in the field, however, at present consumer and clinical viability remains low. A key reason for this is that many of the existing BCI deployments require substantial data collection per end-user, which can be cumbersome, tedious, and error-prone to collect. We address this challenge via a deep learning model, which, when trained across sufficient data from multiple subjects, offers reasonable performance out-of-the-box, and can be customized to novel subjects via a transfer learning process. We demonstrate the fundamental viability of our approach by repurposing an older but well-curated electroencephalography (EEG) dataset and benchmarking against several common approaches/techniques. We then partition this dataset into a transfer learning benchmark and demonstrate that our approach significantly reduces data collection burden per-subject. This suggests that our model and methodology may yield improvements to BCI technologies and enhance their consumer/clinical viability.


title: A Cavity Load Lock Apparatus for Next-Generation Quantum Optics Experiments

abstract: Cavity quantum electrodynamics (QED), the study of the interaction between quantized emitters and photons confined in an optical cavity, is an important tool for quantum science in computing, networking, and synthetic matter. In atomic cavity QED, this approach typically relies upon an ultra-high vacuum chamber that hosts a cold trapped atomic ensemble and an optical cavity. Upgrading the cavity necessitates a months-long laborious process of removing external optics, venting, replacing the resonator, baking, and replacing optics, constituting a substantial bottleneck to innovation in resonator design. In this work, we demonstrate that the flexibility of optical cavities, and the quick turnaround time in switching between them, can be restored with the vacuum loadlock technique--reducing the cycle time to install a cavity, bake it, and transport it into the science chamber to days, achieving 3x10^(-10) Torr pressure in the science chamber. By reducing vacuum limitations, this approach is particularly powerful for labs interested in quickly exploring novel optic cavities, or any other atomic physics relying on in-vacuum optics.


title: Cubic C$_{20}$: An intrinsic superconducting carbon allotrope

abstract: Finding intrinsic carbon superconductor is an interesting topic. Based on density functional first-principles calculations, we first study the phonon-mediated superconductivity in a cubic metallic carbon allotrope, namely sc-C$_{20}$, which has been synthesized in experiment. The electron-phonon coupling is accurately computed with Wannier interpolation method. By solving the Eliashberg equations, we predict that sc-C$_{20}$ is an intrinsic carbon superconductor, without introducing any guest atoms or doping, whose transition temperature is determined to be about 24 K. Our findings enrich the family of carbon-based superconductors.


title: Data-Driven Load-Current Sharing Control for Multi-Stack Fuel Cell System with Circulating Current Mitigation

abstract: The global trend toward renewable power generation has drawn great attention to hydrogen Fuel Cells (FCs), which have a wide variety of applications, from utility power stations to laptops. The Multi-stack Fuel Cell System (MFCS), which is an assembly of FC stacks, can be a remedy for obstacles in high-power applications. However, the output voltage of FC stacks varies dramatically under variable load conditions; hence, in order for MFCS to be efficiently operated and guarantee an appropriate load-current sharing among the FC stacks, advanced converter controllers for power conditioning need to be designed. An accurate circuit model is essential for controller design, which accounts for the fact that the parameters of some converter components may change due to aging and repetitive stress in long-term operations. Existing control frameworks and parametric and non-parametric system identification techniques do not consider the aforementioned challenges. Thus, this paper investigates the potential of a data-driven method that, without system identification, directly implements control on paralleled converters using raw data. Based on pre-collected input/output trajectories, a non-parametric representation of the overall circuit is produced for implementing predictive control. While approaching equal current sharing within the MFCS, the proposed method considers the minimization of load-following error and mitigation of circulating current between the converters. Simulation results verify the effectiveness of the proposed method.


title: Team Resilience under Shock: An Empirical Analysis of GitHub Repositories during Early COVID-19 Pandemic

abstract: While many organizations have shifted to working remotely during the COVID-19 pandemic, how the remote workforce and the remote teams are influenced by and would respond to this and future shocks remain largely unknown. Software developers have relied on remote collaborations long before the pandemic, working in virtual teams (GitHub repositories). The dynamics of these repositories through the pandemic provide a unique opportunity to understand how remote teams react under shock. This work presents a systematic analysis. We measure the overall effect of the early pandemic on public GitHub repositories by comparing their sizes and productivity with the counterfactual outcomes forecasted as if there were no pandemic. We find that the productivity level and the number of active members of these teams vary significantly during different periods of the pandemic. We then conduct a finer-grained investigation and study the heterogeneous effects of the shock on individual teams. We find that the resilience of a team is highly correlated to certain properties of the team before the pandemic. Through a bootstrapped regression analysis, we reveal which types of teams are robust or fragile to the shock.


title: Generalized Ordinal Nash Games: Variational Approach

abstract: It is known that the generalized Nash equilibrium problem can be reformulated as a quasivariational inequality. Our aim in this work is to introduce a variational approach to study the existence of solutions for generalized ordinal Nash games, that is, generalized games where the player preferences are binary relations that do not necessarily admit a utility representation.


title: Model-dependent analysis method for energy budget of the cosmological first-order phase transition

abstract: The kinetic energy of the fluid shell in the cosmological first-order phase transition is crucial for predicting the gravitational wave signals generated by the sound wave mechanism. We propose a model-dependent method to calculate the kinetic energy fraction by dividing the bubble-fluid system into three distinct regions: the symmetric phase, the broken phase, and the bubble wall. By solving the local equation of motion of the scalar field with a phenomenological friction term, the bubble wall velocity and the boundary conditions of the fluid equations of both phases can be derived simultaneously. Then, for a given particle physics model, the fluid profiles of different hydrodynamical modes and the corresponding kinetic energy fraction can be obtained. Our method can also capture the temperature dependency of the sound speed of the plasma. Compared with the conventional model-independent method, our approach is based on an accurate equation of state derived directly from the effective potential and takes into account the contribution of the bubble wall to the energy-momentum tensor. Therefore, our method in-principle provides a more consistent and accurate result, which is crucial for high-precision calculations of the gravitational waves induced by the first-order phase transition.


title: Existence and uniqueness of maximal elements for preference relations: Variational approach

abstract: In this work, we reformulate the problem of existence of maximal elements for preference relations as a variational inequality problem in the sense of Stampacchia. Similarly, we establish the uniqueness of maximal elements using a variational inequality problem in the sense of Minty. In both of these approaches, we use the normal cone operator to find existence and uniqueness results, under mild assumptions. In addition, we provide an algorithm for finding such maximal elements, which is inspired by the steepest descent method for minimization. Under certain conditions, we prove that the sequence generated by this algorithm converges to a maximal element.


title: Nonlocal Kondo effect and two-fluid picture revealed in an exactly solvable model

abstract: Understanding the nature of local-itinerant transition of strongly correlated electrons is one of the central problems in condensed matter physics. Heavy fermion systems describe the f-electron delocalization through Kondo interactions with conduction electrons. Tremendous efforts have been devoted to the so-called Kondo-destruction scenario, which predicts a dramatic local-to-itinerant quantum phase transition of f-electrons at zero temperature. On the other hand, two-fluid behaviors have been observed in many materials, suggesting coexistence of local and itinerant f-electrons over a broad temperature range but lacking a microscopic theoretical description. To elucidate this fundamental issue, here we propose an exactly solvable Kondo-Heisenberg model in which the spins are defined in the momentum space and the k-space Kondo interaction corresponds to a highly nonlocal spin scattering in the coordinate space. Its solution reveals a continuous evolution of the Fermi surfaces with Kondo interaction and two-fluid behaviors similar to those observed in real materials. The electron density violates the usual Luttinger's theorem, but follows a generalized one allowing for partially enlarged Fermi surfaces due to partial Kondo screening in the momentum space. Our results highlight the consequence of nonlocal Kondo interaction relevant for strong quantum fluctuation regions, and provide important insight into the microscopic description of two-fluid phenomenology in heavy fermion systems.


title: Time out of Mind: Generating Rate of Speech conditioned on emotion and speaker

abstract: Voice synthesis has seen significant improvements in the past decade resulting in highly intelligible voices. Further investigations have resulted in models that can produce variable speech, including conditional emotional expression. The problem lies, however, in a focus on phrase-level modifications and prosodic vocal features. Using the CREMA-D dataset we have trained a GAN conditioned on emotion to generate worth lengths for a given input text. These word lengths are relative to neutral speech and can be provided, through speech synthesis markup language (SSML) to a text-to-speech (TTS) system to generate more expressive speech. Additionally, a generative model is also trained using implicit maximum likelihood estimation (IMLE) and a comparative analysis with GANs is included. We were able to achieve better performances on objective measures for neutral speech, and better time alignment for happy speech when compared to an out-of-box model. However, further investigation of subjective evaluation is required.


title: Towards Vision Transformer Unrolling Fixed-Point Algorithm: a Case Study on Image Restoration

abstract: The great success of Deep Neural Networks (DNNs) has inspired the algorithmic development of DNN-based Fixed-Point (DNN-FP) for computer vision tasks. DNN-FP methods, trained by Back-Propagation Through Time or computing the inaccurate inversion of the Jacobian, suffer from inferior representation ability. Motivated by the representation power of the Transformer, we propose a framework to unroll the FP and approximate each unrolled process via Transformer blocks, called FPformer. To reduce the high consumption of memory and computation, we come up with FPRformer by sharing parameters between the successive blocks. We further design a module to adapt Anderson acceleration to FPRformer to enlarge the unrolled iterations and improve the performance, called FPAformer. In order to fully exploit the capability of the Transformer, we apply the proposed model to image restoration, using self-supervised pre-training and supervised fine-tuning. 161 tasks from 4 categories of image restoration problems are used in the pre-training phase. Hereafter, the pre-trained FPformer, FPRformer, and FPAformer are further fine-tuned for the comparison scenarios. Using self-supervised pre-training and supervised fine-tuning, the proposed FPformer, FPRformer, and FPAformer achieve competitive performance with state-of-the-art image restoration methods and better training efficiency. FPAformer employs only 29.82% parameters used in SwinIR models, and provides superior performance after fine-tuning. To train these comparison models, it takes only 26.9% time used for training SwinIR models. It provides a promising way to introduce the Transformer in low-level vision tasks.


title: Deep Learning model integrity checking mechanism using watermarking technique

abstract: In response to the growing popularity of Machine Learning (ML) techniques to solve problems in various industries, various malicious groups have started to target such techniques in their attack plan. However, as ML models are constantly updated with continuous data, it is very hard to monitor the integrity of ML models. One probable solution would be to use hashing techniques. Regardless of how that would mean re-hashing the model each time the model is trained on newer data which is computationally expensive and not a feasible solution for ML models that are trained on continuous data. Therefore, in this paper, we propose a model integrity-checking mechanism that uses model watermarking techniques to monitor the integrity of ML models. We then demonstrate that our proposed technique can monitor the integrity of ML models even when the model is further trained on newer data with a low computational cost. Furthermore, the integrity checking mechanism can be used on Deep Learning models that work on complex data distributions such as Cyber-Physical System applications.


title: Don't Play Favorites: Minority Guidance for Diffusion Models

abstract: We explore the problem of generating minority samples using diffusion models. The minority samples are instances that lie on low-density regions of a data manifold. Generating a sufficient number of such minority instances is important, since they often contain some unique attributes of the data. However, the conventional generation process of the diffusion models mostly yields majority samples (that lie on high-density regions of the manifold) due to their high likelihoods, making themselves ineffective and time-consuming for the minority generating task. In this work, we present a novel framework that can make the generation process of the diffusion models focus on the minority samples. We first highlight that Tweedie's denoising formula yields favorable results for majority samples. The observation motivates us to introduce a metric that describes the uniqueness of a given sample. To address the inherent preference of the diffusion models w.r.t. the majority samples, we further develop minority guidance, a sampling technique that can guide the generation process toward regions with desired likelihood levels. Experiments on benchmark real datasets demonstrate that our minority guidance can greatly improve the capability of generating high-quality minority samples over existing generative samplers. We showcase that the performance benefit of our framework persists even in demanding real-world scenarios such as medical imaging, further underscoring the practical significance of our work. Code is available at https://github.com/soobin-um/minority-guidance.


title: Two-Color Attosecond Chronoscope

abstract: We study ionization of atoms in strong orthogonal two-color ($\omega,2\omega$) (OTC) laser fields numerically and analytically. The calculated photoelectron momentum distribution shows two typical structures: a rectangular-like structure and a shoulder-like structure, the positions of which depend on the laser parameters. Using a strong-field model which allows us to quantitatively evaluate the Coulomb effect, we show that these two structures arise from attosecond response of electron inside an atom to light in OTC-induced photoemission. Some simple mappings between the locations of these structures and response time are derived, with which we are able to establish two-color attosecond chronoscope with high resolution for timing electron emission in OTC-based precise manipulation.


title: A Comparative Study of Solar Active Region 12371 with Data-constrained and Data-driven MHD Simulations

abstract: We performed two data-based magnetohydrodynamic (MHD) simulations for solar active region 12371 which produced an M6.5 flare. The first simulation is a full data-driven simulation where the initial condition is given by a nonlinear force-free field (NLFFF). This NLFFF was extrapolated from photospheric magnetograms approximately 1 hour prior to the flare, and then a time-varying photospheric magnetic field is imposed at the bottom surface. The second simulation is also a data-driven simulation, but it stops driving at the bottom before the time of flare onset and then switches to the data-constrained simulation, where the horizontal component of the magnetic field varies according to an induction equation while the normal component is fixed with time. Both simulations lead to an eruption, with both simulations producing highly twisted field lines before the eruption which were not found in the NLFFF alone. After the eruption, the first simulation based on the time-varying photospheric magneitic field, continues to produce sheared field lines after the flare without reproducing phenomena such as post-flare loops. The second simulation reproduces the phenomena associated with flares well. However in this case the evolution of the bottom magnetic field is inconsistent with the evolution of the observed magnetic field. In this letter, we report potential advantages and disadvantages in data-constrained and data-driven MHD simulations that need to be taken into consideration by future studies.


title: Interaction of oxygen with pristine and defective MoS2 monolayers

abstract: Atom controlled sub-nanometer MoS$_2$ pores have been recently fabricated. Oxidative environments are of particular interest for MoS$_2$ applications in electronics, sensing and energy storage. In this work we carried out first-principles calculations of oxygen adsorption in plain and sub-nanometer MoS$_2$ nanopores. The chemical stability of the layers and pores towards oxygen was verified using density-functional theory. Dissociation and diffusion barriers have been calculated in order to understand surface and pore oxidation and its electronic properties at the atomic scale, which opens the path for future investigations of MoS$_2$ pores in a realistic environment.


title: Spectral inequality for Schr\"odinger equations with power growth potentials

abstract: We prove a spectral inequality for Schr\"odinger equations with power growth potentials, which particularly confirms a conjecture in \cite{DSV}. This spectral inequality depends on the decaying density of the sensor sets, and the growth rate of potentials. The proof relies on three-ball inequalities derived from modified versions of quantitative global and local Carleman estimates that take advantage of the gradient information of the potentials.


title: Compactifications of moduli of del Pezzo surfaces via line arrangement and K-stability

abstract: In this paper, we study compactifications of the moduli of smooth del Pezzo surfaces using K-stability and the line arrangement. We construct K-moduli of log del Pezzo pairs with sum of lines as boundary divisors, and prove that for $d=2,3,4$, these K-moduli of pairs are isomorphic to the K-moduli spaces of del Pezzo surfaces. For $d=1$, we prove that they are different by exhibiting some walls.


title: Incremental Value and Interpretability of Radiomics Features of Both Lung and Epicardial Adipose Tissue for Detecting the Severity of COVID-19 Infection

abstract: Epicardial adipose tissue (EAT) is known for its pro-inflammatory properties and association with Coronavirus Disease 2019 (COVID-19) severity. However, current EAT segmentation methods do not consider positional information. Additionally, the detection of COVID-19 severity lacks consideration for EAT radiomics features, which limits interpretability. This study investigates the use of radiomics features from EAT and lungs to detect the severity of COVID-19 infections. A retrospective analysis of 515 patients with COVID-19 (Cohort1: 415, Cohort2: 100) was conducted using a proposed three-stage deep learning approach for EAT extraction. Lung segmentation was achieved using a published method. A hybrid model for detecting the severity of COVID-19 was built in a derivation cohort, and its performance and uncertainty were evaluated in internal (125, Cohort1) and external (100, Cohort2) validation cohorts. For EAT extraction, the Dice similarity coefficients (DSC) of the two centers were 0.972 (+-0.011) and 0.968 (+-0.005), respectively. For severity detection, the hybrid model with radiomics features of both lungs and EAT showed improvements in AUC, net reclassification improvement (NRI), and integrated discrimination improvement (IDI) compared to the model with only lung radiomics features. The hybrid model exhibited an increase of 0.1 (p<0.001), 19.3%, and 18.0% respectively, in the internal validation cohort and an increase of 0.09 (p<0.001), 18.0%, and 18.0%, respectively, in the external validation cohort while outperforming existing detection methods. Uncertainty quantification and radiomics features analysis confirmed the interpretability of case prediction after inclusion of EAT features.


title: Spin vector deviation and the gravitational wave memory effect between two free-falling gyroscopes in the plane wave spacetime

abstract: In the plane wave spacetime, we find that there will be a precession angle deviation between two free-falling gyroscopes when gravitational waves passed through. This kind of angle deviation is closely related to the well-known standard velocity memory effect. Initial conditions such as the separation velocity or displacement between the two gyroscopes will affect this angle deviation. The evolutions of the angle deviation are calculated for different cases. We find that in some extreme circumstance, the angle deviation's order of magnitude produced by a rotating compact binary source could be $10^{-14}$ rads. Therefore, this memory effect caused by the gravitational wave is likely to be detected in the future.


title: Jiamusi pulsar observations: IV. The core-weak pattern of PSR B0329+54

abstract: The bright pulsar PSR B0329+54 was previously known for many years to have two emission modes. Sensitive observations of individual pulses reveal that the central component of pulse profile, which is called core component, is found to be very weakened occasionally for some periods and then recovered. This is the newly identified core-weak mode. Based on our long observations of PSR B0329+54 by the Jiamusi 66-m telescope at 2250 MHz, we report here that the profile components of individual pulses, including these for the core and the leading and trailing peaks, are relatedly varying over some periods even before and after the core-weak mode, forming a regular pattern in the phase-vs-time plot for a train of period-folded pulses. The pattern has a similar structure for the core-weak mode with a time scale of 3 to 14 periods. It starts with an intensity brightening at the trailing phase of the core component, and then the core intensity declines to a very low level, as if the core component is drifting out from the normal radiation window within one or two periods. Then the intensity for the trailing components is enhanced, and then the leading component appears at an advanced phase. Such a core-weak mode lasts for several periods. Finally, the core-weak mode ends up with an enhanced intensity at the leading phase for the core component, as if the core gradually comes back and finally stays at the phase of the profile center as it used to.


title: Achieving Timestamp Prediction While Recognizing with Non-Autoregressive End-to-End ASR Model

abstract: Conventional ASR systems use frame-level phoneme posterior to conduct force-alignment~(FA) and provide timestamps, while end-to-end ASR systems especially AED based ones are short of such ability. This paper proposes to perform timestamp prediction~(TP) while recognizing by utilizing continuous integrate-and-fire~(CIF) mechanism in non-autoregressive ASR model - Paraformer. Foucing on the fire place bias issue of CIF, we conduct post-processing strategies including fire-delay and silence insertion. Besides, we propose to use scaled-CIF to smooth the weights of CIF output, which is proved beneficial for both ASR and TP task. Accumulated averaging shift~(AAS) and diarization error rate~(DER) are adopted to measure the quality of timestamps and we compare these metrics of proposed system and conventional hybrid force-alignment system. The experiment results over manually-marked timestamps testset show that the proposed optimization methods significantly improve the accuracy of CIF timestamps, reducing 66.7\% and 82.1\% of AAS and DER respectively. Comparing to Kaldi force-alignment trained with the same data, optimized CIF timestamps achieved 12.3\% relative AAS reduction.


title: TJ-FlyingFish: Design and Implementation of an Aerial-Aquatic Quadrotor with Tiltable Propulsion Units

abstract: Aerial-aquatic vehicles are capable to move in the two most dominant fluids, making them more promising for a wide range of applications. We propose a prototype with special designs for propulsion and thruster configuration to cope with the vast differences in the fluid properties of water and air. For propulsion, the operating range is switched for the different mediums by the dual-speed propulsion unit, providing sufficient thrust and also ensuring output efficiency. For thruster configuration, thrust vectoring is realized by the rotation of the propulsion unit around the mount arm, thus enhancing the underwater maneuverability. This paper presents a quadrotor prototype of this concept and the design details and realization in practice.


title: Chemotactic motility-induced phase separation

abstract: Collectives of actively-moving particles can spontaneously separate into dilute and dense phases -- a fascinating phenomenon known as motility-induced phase separation (MIPS). MIPS is well-studied for randomly-moving particles with no directional bias. However, many forms of active matter exhibit collective chemotaxis, directed motion along a chemical gradient that the constituent particles can generate themselves. Here, using theory and simulations, we demonstrate that collective chemotaxis strongly competes with MIPS -- in some cases, arresting or completely suppressing phase separation, or in other cases, generating fundamentally new dynamic instabilities. We establish quantitative principles describing this competition, thereby helping to reveal and clarify the rich physics underlying active matter systems that perform chemotaxis, ranging from cells to robots.

categories: physics.bio-ph cond-mat.soft cond-mat.stat-mech nlin.PS


title: Long-Term Modeling of Financial Machine Learning for Active Portfolio Management

abstract: In the practical business of asset management by investment trusts and the like, the general practice is to manage over the medium to long term owing to the burden of operations and increase in transaction costs with the increase in turnover ratio. However, when machine learning is used to construct a management model, the number of learning data decreases with the increase in the long-term time scale; this causes a decline in the learning precision. Accordingly, in this study, data augmentation was applied by the combined use of not only the time scales of the target tasks but also the learning data of shorter term time scales, demonstrating that degradation of the generalization performance can be inhibited even if the target tasks of machine learning have long-term time scales. Moreover, as an illustration of how this data augmentation can be applied, we conducted portfolio management in which machine learning of a multifactor model was done by an autoencoder and mispricing was used from the estimated theoretical values. The effectiveness could be confirmed in not only the stock market but also the FX market, and a general-purpose management model could be constructed in various financial markets.


title: Academic Institutions in Multilateral Data Governance: Emerging Arrangements for Negotiating Risk, Value and Ethics in the Big Data Economy

abstract: Data sharing partnerships are increasingly an imperative for research institutions and, at the same time, a challenge for established models of data governance and ethical research oversight. We analyse four cases of data partnership involving academic institutions and examine the role afforded to the research partner in negotiating the relationship between risk, value, trust and ethics. Within this terrain, far from being a restraint on financialisation, the instrumentation of ethics forms part of the wider mobilisation of infrastructure for the realisation of profit in the big data economy. Under what we term `combinatorial data governance' academic structures for the management of research ethics are instrumentalised as organisational functions that serve to mitigate reputational damage and societal distrust. In the alternative model of `experimental data governance' researchers propose frameworks and instruments for the rethinking of data ethics and the risks associated with it - a model that is promising but limited in its practical application.


title: Demystifying Privacy Policy of Third-Party Libraries in Mobile Apps

abstract: The privacy of personal information has received significant attention in mobile software. Although previous researchers have designed some methods to identify the conflict between app behavior and privacy policies, little is known about investigating regulation requirements for third-party libraries (TPLs). The regulators enacted multiple regulations to regulate the usage of personal information for TPLs (e.g., the "California Consumer Privacy Act" requires businesses clearly notify consumers if they share consumers' data with third parties or not). However, it remains challenging to analyze the legality of TPLs due to three reasons: 1) TPLs are mainly published on public repositoriesinstead of app market (e.g., Google play). The public repositories do not perform privacy compliance analysis for each TPL. 2) TPLs only provide independent functions or function sequences. They cannot run independently, which limits the application of performing dynamic analysis. 3) Since not all the functions of TPLs are related to user privacy, we must locate the functions of TPLs that access/process personal information before performing privacy compliance analysis. To overcome the above challenges, in this paper, we propose an automated system named ATPChecker to analyze whether the Android TPLs meet privacy-related regulations or not. Our findings remind developers to be mindful of TPL usage when developing apps or writing privacy policies to avoid violating regulations.


title: Encoding Node Diffusion Competence and Role Significance for Network Dismantling

abstract: Percolation theory shows that removing a small fraction of critical nodes can lead to the disintegration of a large network into many disconnected tiny subnetworks. The network dismantling task focuses on how to efficiently select the least such critical nodes. Most existing approaches focus on measuring nodes' importance from either functional or topological viewpoint. Different from theirs, we argue that nodes' importance can be measured from both of the two complementary aspects: The functional importance can be based on the nodes' competence in relaying network information; While the topological importance can be measured from nodes' regional structural patterns. In this paper, we propose an unsupervised learning framework for network dismantling, called DCRS, which encodes and fuses both node diffusion competence and role significance. Specifically, we propose a graph diffusion neural network which emulates information diffusion for competence encoding; We divide nodes with similar egonet structural patterns into a few roles, and construct a role graph on which to encode node role significance. The DCRS converts and fuses the two encodings to output a final ranking score for selecting critical nodes. Experiments on both real-world networks and synthetic networks demonstrate that our scheme significantly outperforms the state-of-the-art competitors for its mostly requiring much fewer nodes to dismantle a network.


title: On a family of 2-automatic sequences generating algebraic continued fractions in characteristic 2

abstract: We present family of automatic sequences that define algebraic continued fractions in characteristic 2. This family is constructed from ultimately period words and contains the period-doubling sequence.


title: Emerging Synergies in Causality and Deep Generative Models: A Survey

abstract: In the field of artificial intelligence (AI), the quest to understand and model data-generating processes (DGPs) is of paramount importance. Deep generative models (DGMs) have proven adept in capturing complex data distributions but often fall short in generalization and interpretability. On the other hand, causality offers a structured lens to comprehend the mechanisms driving data generation and highlights the causal-effect dynamics inherent in these processes. While causality excels in interpretability and the ability to extrapolate, it grapples with intricacies of high-dimensional spaces. Recognizing the synergistic potential, we delve into the confluence of causality and DGMs. We elucidate the integration of causal principles within DGMs, investigate causal identification using DGMs, and navigate an emerging research frontier of causality in large-scale generative models, particularly generative large language models (LLMs). We offer insights into methodologies, highlight open challenges, and suggest future directions, positioning our comprehensive review as an essential guide in this swiftly emerging and evolving area.


title: Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation

abstract: Unsupervised Video Object Segmentation (UVOS) aims at discovering objects and tracking them through videos. For accurate UVOS, we observe if one can locate precise segment proposals on key frames, subsequent processes are much simpler. Hence, we propose to reason about key frame proposals using a graph built with the object probability masks initially generated from multiple frames around the key frame and then propagated to the key frame. On this graph, we compute maximal cliques, with each clique representing one candidate object. By making multiple proposals in the clique to vote for the key frame proposal, we obtain refined key frame proposals that could be better than any of the single-frame proposals. A semi-supervised VOS algorithm subsequently tracks these key frame proposals to the entire video. Our algorithm is modular and hence can be used with any instance segmentation and semi-supervised VOS algorithm. We achieve state-of-the-art performance on the DAVIS-2017 validation and test-dev dataset. On the related problem of video instance segmentation, our method shows competitive performance with the previous best algorithm that requires joint training with the VOS algorithm.


title: On Enhancing Expressive Power via Compositions of Single Fixed-Size ReLU Network

abstract: This paper explores the expressive power of deep neural networks through the framework of function compositions. We demonstrate that the repeated compositions of a single fixed-size ReLU network exhibit surprising expressive power, despite the limited expressive capabilities of the individual network itself. Specifically, we prove by construction that $\mathcal{L}_2\circ \boldsymbol{g}^{\circ r}\circ \boldsymbol{\mathcal{L}}_1$ can approximate $1$-Lipschitz continuous functions on $[0,1]^d$ with an error $\mathcal{O}(r^{-1/d})$, where $\boldsymbol{g}$ is realized by a fixed-size ReLU network, $\boldsymbol{\mathcal{L}}_1$ and $\mathcal{L}_2$ are two affine linear maps matching the dimensions, and $\boldsymbol{g}^{\circ r}$ denotes the $r$-times composition of $\boldsymbol{g}$. Furthermore, we extend such a result to generic continuous functions on $[0,1]^d$ with the approximation error characterized by the modulus of continuity. Our results reveal that a continuous-depth network generated via a dynamical system has immense approximation power even if its dynamics function is time-independent and realized by a fixed-size ReLU network.


title: Artistic Curve Steganography Carried by Musical Audio

abstract: In this work, we create artistic closed loop curves that trace out images and 3D shapes, which we then hide in musical audio as a form of steganography. We use traveling salesperson art to create artistic plane loops to trace out image contours, and we use Hamiltonian cycles on triangle meshes to create artistic space loops that fill out 3D surfaces. Our embedding scheme is designed to faithfully preserve the geometry of these loops after lossy compression, while keeping their presence undetectable to the audio listener. To accomplish this, we hide each dimension of the curve in a different frequency, and we perturb a sliding window sum of the magnitude of that frequency to best match the target curve at that dimension, while hiding scale information in that frequency's phase. In the process, we exploit geometric properties of the curves to help to more effectively hide and recover them. Our scheme is simple and encoding happens efficiently with a nonnegative least squares framework, while decoding is trivial. We validate our technique quantitatively on large datasets of images and audio, and we show results of a crowd sourced listening test that validate that the hidden information is indeed unobtrusive.


title: Semantics-enhanced Temporal Graph Networks for Content Popularity Prediction

abstract: The surging demand for high-definition video streaming services and large neural network models (e.g., Generative Pre-trained Transformer, GPT) implies a tremendous explosion of Internet traffic. To mitigate the traffic pressure, architectures with in-network storage have been proposed to cache popular contents at devices in closer proximity to users. Correspondingly, in order to maximize caching utilization, it becomes essential to devise an effective popularity prediction method. In that regard, predicting popularity with dynamic graph neural network (DGNN) models achieve remarkable performance. However, DGNN models still suffer from tackling sparse datasets where most users are inactive. Therefore, we propose a reformative temporal graph network, named semantics-enhanced temporal graph network (STGN), which attaches extra semantic information into the user-content bipartite graph and could better leverage implicit relationships behind the superficial topology structure. On top of that, we customize its temporal and structural learning modules to further boost the prediction performance. Specifically, in order to efficiently aggregate the diversified semantics that a content might possess, we design a user-specific attention (UsAttn) mechanism for temporal learning module. Unlike the attention mechanism that only analyzes the influence of genres on content, UsAttn also considers the attraction of semantic information to a specific user. Meanwhile, as for the structural learning, we introduce the concept of positional encoding into our attention-based graph learning and adopt a semantic positional encoding (SPE) function to facilitate the analysis of content-oriented user-association analysis. Finally, extensive simulations verify the superiority of our STGN models and demonstrate the effectiveness in content caching.


title: Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns

abstract: Spiking Neural Networks (SNNs) use discrete spike sequences to transmit information, which significantly mimics the information transmission of the brain. Although this binarized form of representation dramatically enhances the energy efficiency and robustness of SNNs, it also leaves a large gap between the performance of SNNs and Artificial Neural Networks based on real values. There are many different spike patterns in the brain, and the dynamic synergy of these spike patterns greatly enriches the representation capability. Inspired by spike patterns in biological neurons, this paper introduces the dynamic Burst pattern and designs the Leaky Integrate and Fire or Burst (LIFB) neuron that can make a trade-off between short-time performance and dynamic temporal performance from the perspective of network information capacity. LIFB neuron exhibits three modes, resting, Regular spike, and Burst spike. The burst density of the neuron can be adaptively adjusted, which significantly enriches the characterization capability. We also propose a decoupling method that can losslessly decouple LIFB neurons into equivalent LIF neurons, which demonstrates that LIFB neurons can be efficiently implemented on neuromorphic hardware. We conducted experiments on the static datasets CIFAR10, CIFAR100, and ImageNet, which showed that we greatly improved the performance of the SNNs while significantly reducing the network latency. We also conducted experiments on neuromorphic datasets DVS-CIFAR10 and NCALTECH101 and showed that we achieved state-of-the-art with a small network structure.


title: SPEED: Experimental Design for Policy Evaluation in Linear Heteroscedastic Bandits

abstract: In this paper, we study the problem of optimal data collection for policy evaluation in linear bandits. In policy evaluation, we are given a target policy and asked to estimate the expected reward it will obtain when executed in a multi-armed bandit environment. Our work is the first work that focuses on such optimal data collection strategy for policy evaluation involving heteroscedastic reward noise in the linear bandit setting. We first formulate an optimal design for weighted least squares estimates in the heteroscedastic linear bandit setting that reduces the MSE of the value of the target policy. We then use this formulation to derive the optimal allocation of samples per action during data collection. We then introduce a novel algorithm SPEED (Structured Policy Evaluation Experimental Design) that tracks the optimal design and derive its regret with respect to the optimal design. Finally, we empirically validate that SPEED leads to policy evaluation with mean squared error comparable to the oracle strategy and significantly lower than simply running the target policy.


title: Unified multivariate trace estimation and quantum error mitigation

abstract: Calculating the trace of the product of $m$ $n$-qubit density matrices (multivariate trace) is a crucial subroutine in quantum error mitigation and information measures estimation. We propose an unified multivariate trace estimation (UMT) which conceptually unifies the previous qubit-optimal and depth-optimal approaches with tunable quantum circuit depth and the number of qubits. The constructed circuits have $\lceil(m-1)/s\rceil$ or $n\lceil(m-1)/s\rceil$ depth corresponding to $(s+m)n$ or $s+mn$ qubits for $s\in\{1,\cdots,\lfloor m/2\rfloor\}$, respectively. Such flexible circuit structures enable people to choose suitable circuits according different hardware devices. We apply UMT to virtual distillation for achieving exponential error suppression and design a family of concrete circuits to calculate the trace of the product of $8$ and $9$ $n$-qubit density matrices. Numerical example shows that the additional circuits still mitigate the noise expectation value under the global depolarizing channel.


title: GTC/CanariCam Mid-IR Polarimetry of Magnetic Fields in Star-Forming Region W51 IRS2

abstract: We present 0.4 arcsec-resolution imaging polarimetry at 8.7, 10.3, and 12.5 microns, obtained with CanariCam at the Gran Telescopio Canarias, of the central region of W51 IRS2. The polarization, as high as 14 percent, arises from silicate particles aligned by the interstellar magnetic field. We separate, or unfold, the polarization of each sightline into emission and absorption components, from which we infer the morphologies of the corresponding projected magnetic fields that thread the emitting and foreground-absorbing regions. We conclude that the projected magnetic field in the foreground material is part of the larger-scale ambient field. The morphology of the projected magnetic field in the mid-IR emitting region spanning the cometary HII region W51 IRS2W is similar to that in the absorbing region. Elsewhere, the two magnetic fields differ significantly with no clear relationship between them. The magnetic field across the W51 IRS2W cometary core appears to be an integral part of a champagne outflow of gas originating in the core and dominating the energetics there. The bipolar outflow, W51north jet, that appears to originate at or near SMA1/N1 coincides almost exactly with a clearly demarcated north-south swath of lower polarization. While speculative, comparison of mid-IR and submm polarimetry on two different scales may support a picture in which SMA1/N1 plays a major role in the magnetic field structure across W51 IRS2.


title: ADL-ID: Adversarial Disentanglement Learning for Wireless Device Fingerprinting Temporal Domain Adaptation

abstract: As the journey of 5G standardization is coming to an end, academia and industry have already begun to consider the sixth-generation (6G) wireless networks, with an aim to meet the service demands for the next decade. Deep learning-based RF fingerprinting (DL-RFFP) has recently been recognized as a potential solution for enabling key wireless network applications and services, such as spectrum policy enforcement and network access control. The state-of-the-art DL-RFFP frameworks suffer from a significant performance drop when tested with data drawn from a domain that is different from that used for training data. In this paper, we propose ADL-ID, an unsupervised domain adaption framework that is based on adversarial disentanglement representation to address the temporal domain adaptation for the RFFP task. Our framework has been evaluated on real LoRa and WiFi datasets and showed about 24% improvement in accuracy when compared to the baseline CNN network on short-term temporal adaptation. It also improves the classification accuracy by up to 9% on long-term temporal adaptation. Furthermore, we release a 5-day, 2.1TB, large-scale WiFi 802.11b dataset collected from 50 Pycom devices to support the research community efforts in developing and validating robust RFFP methods.


title: Graph Harmony: Denoising and Nuclear-Norm Wasserstein Adaptation for Enhanced Domain Transfer in Graph-Structured Data

abstract: Graph-structured data can be found in numerous domains, yet the scarcity of labeled instances hinders its effective utilization of deep learning in many scenarios. Traditional unsupervised domain adaptation (UDA) strategies for graphs primarily hinge on adversarial learning and pseudo-labeling. These approaches fail to effectively leverage graph discriminative features, leading to class mismatching and unreliable label quality. To navigate these obstacles, we develop the Denoising and Nuclear-Norm Wasserstein Adaptation Network (DNAN). DNAN employs the Nuclear-norm Wasserstein discrepancy (NWD), which can simultaneously achieve domain alignment and class distinguishment. DANA also integrates a denoising mechanism via a variational graph autoencoder that mitigates data noise. This denoising mechanism helps capture essential features of both source and target domains, improving the robustness of the domain adaptation process. Our comprehensive experiments demonstrate that DNAN outperforms state-of-the-art methods on standard UDA benchmarks for graph classification.


title: Future change in the solar wind and Central England temperature: implications for climate change attribution

abstract: The recent increase in global temperature is attributed to anthropological global warming, (A.G.W), with a minor role for natural trends in temperature. The I.P.P.C estimates natural temperature (NAT) from climate models and attributes the difference from recent recorded temperature to A.G.W. We use the temperature record to assess if trends in temperature are due to NAT or A.G.W effects. The method requires long records like the 362-year Central England temperature (C.E.T) record. The C.E.T was divided into a 262 year-long early part when only NAT was significant, and a 100 year-long later part. The early part was decomposed into eight components in the spectral range 15 to 257 years and the components were forward projected to the next 100 years. The projected NAT replicated the recorded cooling from 1950 to 1980 and the rapid increase from 1980 to 2010, indicating that the recent strong 50-year trend in C.E.T was primarily NAT. Based on the small difference between the projected NAT and the recorded C.E.T a minor role was attributed to A.G.W and a climate sensitivity to CO2 doubling of 0.7 +/- 0.2 K estimated. Components, at 514 and 1028 years, were derived from the C.E.T record providing a means for validation of long projections against proxy records of past temperature. Future projection of combined NAT and A.G.W indicated a cooling of C.E.T by 0.5 C from now to year 2060 before A.G.W becomes dominant. The possible cause of an imminent decrease in C.E.T was explored by applying the same method of component estimation to temperature data from Melbourne, Australia (MET) and the geomagnetic a.a index, a proxy for the solar wind. Comparing cyclic variations of the a.a index and the C.E.T and MET data indicated a complex relationship with the strong recent increase in C.E.T and MET lagging the increase in the solar wind by ~15 years.


title: NeuralKalman: A Learnable Kalman Filter for Acoustic Echo Cancellation

abstract: The robustness of the Kalman filter to double talk and its rapid convergence make it a popular approach for addressing acoustic echo cancellation (AEC) challenges. However, the inability to model nonlinearity and the need to tune control parameters cast limitations on such adaptive filtering algorithms. In this paper, we integrate the frequency domain Kalman filter (FDKF) and deep neural networks (DNNs) into a hybrid method, called NeuralKalman, to leverage the advantages of deep learning and adaptive filtering algorithms. Specifically, we employ a DNN to estimate nonlinearly distorted far-end signals, a transition factor, and the nonlinear transition function in the state equation of the FDKF algorithm. Experimental results show that the proposed NeuralKalman improves the performance of FDKF significantly and outperforms strong baseline methods.


title: Fair Decision-making Under Uncertainty

abstract: There has been concern within the artificial intelligence (AI) community and the broader society regarding the potential lack of fairness of AI-based decision-making systems. Surprisingly, there is little work quantifying and guaranteeing fairness in the presence of uncertainty which is prevalent in many socially sensitive applications, ranging from marketing analytics to actuarial analysis and recidivism prediction instruments. To this end, we study a longitudinal censored learning problem subject to fairness constraints, where we require that algorithmic decisions made do not affect certain individuals or social groups negatively in the presence of uncertainty on class label due to censorship. We argue that this formulation has a broader applicability to practical scenarios concerning fairness. We show how the newly devised fairness notions involving censored information and the general framework for fair predictions in the presence of censorship allow us to measure and mitigate discrimination under uncertainty that bridges the gap with real-world applications. Empirical evaluations on real-world discriminated datasets with censorship demonstrate the practicality of our approach.


title: 2D internal waves in an ergodic setting

abstract: We study a model of internal waves under periodic forcing in an effectively 2-dimensional aquarium. When the underlying classical dynamics has sufficiently irrational rotation number, we prove that the solution to the internal waves equation remains bounded in energy space in time. This result is in contrast with the works by Colin de Verdi\`ere--Saint-Raymond and Dyatlov--Wang--Zworski, which gave a description of singular profiles when the underlying dynamics has periodic attractors. Our result is proved by showing the spectral measure near the forcing frequency is very small.


title: Smooth Non-Stationary Bandits

abstract: In many applications of online decision making, the environment is non-stationary and it is therefore crucial to use bandit algorithms that handle changes. Most existing approaches are designed to protect against non-smooth changes, constrained only by total variation or Lipschitzness over time, where they guarantee $\tilde \Theta(T^{2/3})$ regret. However, in practice environments are often changing {\bf smoothly}, so such algorithms may incur higher-than-necessary regret in these settings and do not leverage information on the rate of change. We study a non-stationary two-armed bandits problem where we assume that an arm's mean reward is a $\beta$-H\"older function over (normalized) time, meaning it is $(\beta-1)$-times Lipschitz-continuously differentiable. We show the first separation between the smooth and non-smooth regimes by presenting a policy with $\tilde O(T^{3/5})$ regret for $\beta=2$. We complement this result by an $\Omg(T^{(\beta+1)/(2\beta+1)})$ lower bound for any integer $\beta\ge 1$, which matches our upper bound for $\beta=2$.


title: On Representations of Affine Temperley--Lieb Algebras

abstract: We study the finite-dimensional simple modules, over an algebraically closed field, of the affine Temperley--Lieb algebra corresponding to the affine Weyl group of type $A$. These turn out to be closely related to the simple modules for a certain $q$-analogue of the annular algebra of V.F.R. Jones.


title: Observation of superconducting vortices carrying a temperature-dependent fraction of the flux quantum

abstract: The magnetic response is a state-defining property of superconductors. The magnetic flux penetrates type-II bulk superconductors by forming quantum vortices when the enclosed magnetic flux is equal to the magnetic flux quantum. The flux quantum is the universal quantity that depends only on the ratio of fundamental constants: the electron charge and the Planck constant. This work investigates the vortex state in the hole-overdoped Ba$_{1-x}$K$_x$Fe$_2$As$_2$ by using scanning superconducting quantum interference device (SQUID) magnetometry. We observed quantum vortices that carry only a fraction of the flux quantum, which vary continuously with temperature. This finding establishes the phenomenon that superconductors support quantum vortices with non-universally quantized magnetic flux. Furthermore, the demonstrations of the mobility of the fractional vortices and the manipulability of their positions open up a route for future fluxonics applications.


title: Preserving Fairness in AI under Domain Shift

abstract: Existing algorithms for ensuring fairness in AI use a single-shot training strategy, where an AI model is trained on an annotated training dataset with sensitive attributes and then fielded for utilization. This training strategy is effective in problems with stationary distributions, where both training and testing data are drawn from the same distribution. However, it is vulnerable with respect to distributional shifts in the input space that may occur after the initial training phase. As a result, the time-dependent nature of data can introduce biases into the model predictions. Model retraining from scratch using a new annotated dataset is a naive solution that is expensive and time-consuming. We develop an algorithm to adapt a fair model to remain fair under domain shift using solely new unannotated data points. We recast this learning setting as an unsupervised domain adaptation problem. Our algorithm is based on updating the model such that the internal representation of data remains unbiased despite distributional shifts in the input space. We provide extensive empirical validation on three widely employed fairness datasets to demonstrate the effectiveness of our algorithm.


title: PDM KG-Coulombic particles in cosmic string rainbow gravity spacetime and a uniform magnetic field

abstract: Klein-Gordon (KG) particles in cosmic string rainbow gravity spacetime and a uniform magnetic field are studied in the context of the so called, metaphorically speaking, position-dependent mass (PDM) settings. We show that the corresponding KG-equation collapses into a two-dimensional radial Schr\"{o}dinger-Coulomb like model. The exact textbook solution of which is used to find the energies and wave functions of KG-Coulombic particles (both constant mass and PDM ones). In so doing, we consider, with $y=E/E_{P}$, four pairs of rainbow functions: (a) $% g_{_{0}}\left( y\right) =1$, $g_{_{1}}\left( y\right) =\sqrt{1-\epsilon y^{2}% }$, (b) $g_{_{0}}\left( y\right) =1$, $g_{_{1}}\left( y\right) =\sqrt{% 1-\epsilon y}$, (c) $g_{_{0}}\left( y\right) =g_{_{1}}\left( y\right) =\left( 1-\epsilon y\right) ^{-1}$, and (d) $g_{_{0}}( y) =(e^{\epsilon y}-1) /\epsilon y$, $g_{_{1}}\left( y\right) =1$. Interestingly, we observe that the first pair in (a) introduces the Planck energy $E_{p}$ as a maximum possible KG-particle/antiparticle energy value.


title: Antithetic Multilevel Particle Filters

abstract: In this paper we consider the filtering of partially observed multi-dimensional diffusion processes that are observed regularly at discrete times. This is a challenging problem which requires the use of advanced numerical schemes based upon time-discretization of the diffusion process and then the application of particle filters. Perhaps the state-of-the-art method for moderate dimensional problems is the multilevel particle filter of \cite{mlpf}. This is a method that combines multilevel Monte Carlo and particle filters. The approach in that article is based intrinsically upon an Euler discretization method. We develop a new particle filter based upon the antithetic truncated Milstein scheme of \cite{ml_anti}. We show that for a class of diffusion problems, for $\epsilon>0$ given, that the cost to produce a mean square error (MSE) in estimation of the filter, of $\mathcal{O}(\epsilon^2)$ is $\mathcal{O}(\epsilon^{-2}\log(\epsilon)^2)$. In the case of multidimensional diffusions with non-constant diffusion coefficient, the method of \cite{mlpf} has a cost of $\mathcal{O}(\epsilon^{-2.5})$ to achieve the same MSE. We support our theory with numerical results in several examples.


title: Delay-Adaptive Boundary Control of Coupled Hyperbolic PDE-ODE Cascade Systems

abstract: This paper presents a delay-adaptive boundary control scheme for a $2\times 2$ coupled linear hyperbolic PDE-ODE cascade system with an unknown and arbitrarily long input delay. To construct a nominal delay-compensated control law, assuming a known input delay, a three-step backstepping design is used. Based on the certainty equivalence principle, the nominal control action is fed with the estimate of the unknown delay, which is generated from a batch least-squares identifier that is updated by an event-triggering mechanism that evaluates the growth of the norm of the system states. As a result of the closed-loop system, the actuator and plant states can be regulated exponentially while avoiding Zeno occurrences. A finite-time exact identification of the unknown delay is also achieved except for the case that all initial states of the plant are zero. As far as we know, this is the first delay-adaptive control result for systems governed by heterodirectional hyperbolic PDEs. The effectiveness of the proposed design is demonstrated in the control application of a deep-sea construction vessel with cable-payload oscillations and subject to input delay.


title: Temperature behavior of the Optical Absorption and Photoluminescence Spectra of InP/ZnS Nanocrystals with a Stabilizing Polyvinylpyrrolidone-based Coating

abstract: The present paper deals with the results of a research work on the optical properties of colloidal InP/ZnS nanocrystals stabilized with a heterobifunctional polyvinylpyrrolidone polymer. We have analyzed the absorption and photoluminescence spectra of the samples as solutions with various concentrations and deposited films, as well as the patterns of their temperature changes in the range of 6.5 - 296 K. An inhomogeneous broadening of exciton optical bands has been observed to be related to a wide distribution of nanocrystals in size. A temperature shift of the exciton absorption and emission maxima has been found to be due to the interaction with acoustic phonons. It has been shown that the quenching of defect-related luminescence is carried out through local energy levels of dangling bonds of phosphorus atoms involved at the core-shell interface, and the temperature stability of exciton emission is determined by the thickness of the ZnS shell.


title: Reidemeister classes, wreath products and solvability

abstract: Reidemeister (or twisted conjugacy) classes are considered in restricted wreath products of the form $G\wr \mathbb{Z}^k$, where $G$ is a finite group. For an automorphism $\varphi$ of finite order (supposed to be the same for the torsion subgroup $\oplus G$ and the quotient $\mathbb{Z}^k$) with finite number $R(\varphi)$ of Reidemeister classes, this number is identified with the number of equivalence classes of finite-dimensional unitary irreducible representations of the product that are fixed by the dual homeomorphism $\widehat{\varphi}$ (i.e. the so-called conjecture TBFT$_f$ is proved in this case). For these groups and automorphisms, we prove the following conjecture: if a finitely generated residually finite group has an automorphism with $R(\varphi)<\infty$ then it is solvable-by-finite (so-called conjecture R).


title: 2022 Update on $\varepsilon_K$ with lattice QCD inputs

abstract: We present recent updates for $\varepsilon_K$ determined directly from the standard model (SM) with lattice QCD inputs such as $\hat{B}_K$, $|V_{cb}|$, $|V_{us}|$, $\xi_0$, $\xi_2$, $\xi_\text{LD}$, $f_K$, and $m_c$. We find that the standard model with exclusive $|V_{cb}|$ and other lattice QCD inputs describes only 65% of the experimental value of $|\varepsilon_K|$ and does not explain its remaining 35%, which leads to a strong tension in $|\varepsilon_K|$ at the $5.1\sigma \sim 3.9\sigma$ level between the SM theory and experiment. We also find that this tension disappears when we use the inclusive value of $|V_{cb}|$ obtained using the heavy quark expansion based on the QCD sum rule approach, although this inclusive tension is small ($\approx 1.4\sigma$) but keeps increasing as time goes on.


title: Enhancing Dialogue Summarization with Topic-Aware Global- and Local- Level Centrality

abstract: Dialogue summarization aims to condense a given dialogue into a simple and focused summary text. Typically, both the roles' viewpoints and conversational topics change in the dialogue stream. Thus how to effectively handle the shifting topics and select the most salient utterance becomes one of the major challenges of this task. In this paper, we propose a novel topic-aware Global-Local Centrality (GLC) model to help select the salient context from all sub-topics. The centralities are constructed at both the global and local levels. The global one aims to identify vital sub-topics in the dialogue and the local one aims to select the most important context in each sub-topic. Specifically, the GLC collects sub-topic based on the utterance representations. And each utterance is aligned with one sub-topic. Based on the sub-topics, the GLC calculates global- and local-level centralities. Finally, we combine the two to guide the model to capture both salient context and sub-topics when generating summaries. Experimental results show that our model outperforms strong baselines on three public dialogue summarization datasets: CSDS, MC, and SAMSUM. Further analysis demonstrates that our GLC can exactly identify vital contents from sub-topics.~\footnote{\url{https://github.com/xnliang98/bart-glc}}


title: What Challenges Do Developers Face About Checked-in Secrets in Software Artifacts?

abstract: Throughout 2021, GitGuardian's monitoring of public GitHub repositories revealed a two-fold increase in the number of secrets (database credentials, API keys, and other credentials) exposed compared to 2020, accumulating more than six million secrets. To our knowledge, the challenges developers face to avoid checked-in secrets are not yet characterized. The goal of our paper is to aid researchers and tool developers in understanding and prioritizing opportunities for future research and tool automation for mitigating checked-in secrets through an empirical investigation of challenges and solutions related to checked-in secrets. We extract 779 questions related to checked-in secrets on Stack Exchange and apply qualitative analysis to determine the challenges and the solutions posed by others for each of the challenges. We identify 27 challenges and 13 solutions. The four most common challenges, in ranked order, are: (i) store/version of secrets during deployment; (ii) store/version of secrets in source code; (iii) ignore/hide of secrets in source code; and (iv) sanitize VCS history. The three most common solutions, in ranked order, are: (i) move secrets out of source code/version control and use template config file; (ii) secret management in deployment; and (iii) use local environment variables. Our findings indicate that the same solution has been mentioned to mitigate multiple challenges. However, our findings also identify an increasing trend in questions lacking accepted solutions substantiating the need for future research and tool automation on managing secrets.


title: Towards Inference Efficient Deep Ensemble Learning

abstract: Ensemble methods can deliver surprising performance gains but also bring significantly higher computational costs, e.g., can be up to 2048X in large-scale ensemble tasks. However, we found that the majority of computations in ensemble methods are redundant. For instance, over 77% of samples in CIFAR-100 dataset can be correctly classified with only a single ResNet-18 model, which indicates that only around 23% of the samples need an ensemble of extra models. To this end, we propose an inference efficient ensemble learning method, to simultaneously optimize for effectiveness and efficiency in ensemble learning. More specifically, we regard ensemble of models as a sequential inference process and learn the optimal halting event for inference on a specific sample. At each timestep of the inference process, a common selector judges if the current ensemble has reached ensemble effectiveness and halt further inference, otherwise filters this challenging sample for the subsequent models to conduct more powerful ensemble. Both the base models and common selector are jointly optimized to dynamically adjust ensemble inference for different samples with various hardness, through the novel optimization goals including sequential ensemble boosting and computation saving. The experiments with different backbones on real-world datasets illustrate our method can bring up to 56\% inference cost reduction while maintaining comparable performance to full ensemble, achieving significantly better ensemble utility than other baselines. Code and supplemental materials are available at https://seqml.github.io/irene.


title: FedRC: Tackling Diverse Distribution Shifts Challenge in Federated Learning by Robust Clustering

abstract: Federated Learning (FL) is a machine learning paradigm that safeguards privacy by retaining client data on edge devices. However, optimizing FL in practice can be challenging due to the diverse and heterogeneous nature of the learning system. Though recent research has focused on improving the optimization of FL when distribution shifts occur among clients, ensuring global performance when multiple types of distribution shifts occur simultaneously among clients -- such as feature distribution shift, label distribution shift, and concept shift -- remain under-explored. In this paper, we identify the learning challenges posed by the simultaneous occurrence of diverse distribution shifts and propose a clustering principle to overcome these challenges. Through our research, we find that existing methods fail to address the clustering principle. Therefore, we propose a novel clustering algorithm framework, dubbed as FedRC, which adheres to our proposed clustering principle by incorporating a bi-level optimization problem and a novel objective function. Extensive experiments demonstrate that FedRC significantly outperforms other SOTA cluster-based FL methods. Our code is available at \url{https://github.com/LINs-lab/FedRC}.