title: PathoWAve: A Deep Learning-based Weight Averaging Method for Improving Domain Generalization in Histopathology Images

abstract: Recent advancements in deep learning (DL) have significantly advanced medical image analysis. In the field of medical image processing, particularly in histopathology image analysis, the variation in staining protocols and differences in scanners present significant domain shift challenges, undermine the generalization capabilities of models to the data from unseen domains, prompting the need for effective domain generalization (DG) strategies to improve the consistency and reliability of automated cancer detection tools in diagnostic decision-making. In this paper, we introduce Pathology Weight Averaging (PathoWAve), a multi-source DG strategy for addressing domain shift phenomenon of DL models in histopathology image analysis. Integrating specific weight averaging technique with parallel training trajectories and a strategically combination of regular augmentations with histopathology-specific data augmentation methods, PathoWAve enables a comprehensive exploration and precise convergence within the loss landscape. This method significantly enhanced generalization capabilities of DL models across new, unseen histopathology domains. To the best of our knowledge, PathoWAve is the first proposed weight averaging method for DG in histopathology image analysis. Our quantitative results on Camelyon17 WILDS dataset demonstrate PathoWAve's superiority over previous proposed methods to tackle the domain shift phenomenon in histopathology image processing. Our code is available at \url{https://github.com/ParastooSotoudeh/PathoWAve}.


title: The Case for Transport-Level Encryption in Datacenter Networks

abstract: Cloud applications need network data encryption to isolate from other tenants and protect their data from potential eavesdroppers in the network infrastructure. This paper presents SDP, a protocol design for emerging datacenter transport protocols, such as pHost, NDP, and Homa, to integrate data encryption with the use of existing NIC offloading of cryptographic operations designed for TLS over TCP. Therefore, SDP could enable a deployment path of new transport protocols in datacenters without giving up hardware offloading support, which would otherwise make encryption on those protocols even slower than TLS over TCP. SDP is based on Homa, and outperforms TLS over TCP by up to 29 % in throughput. SDP currently supports two real-world applications, Redis, improving throughput by up to 24 %, and in-kernel NVMe-oF, cutting P99 latency by up to 21 %.


title: Canceled: A New Reliability Incentive for Energy-Only Electricity Markets

abstract: This paper considers the reliability problem in energy-only markets. Following widespread blackouts in 2011, Texas introduced a reliability price incentive to attract two GW of net additional natural gas-generating capacity. The incentive is unusual because energy buyers pay the incentive directly to producers in a real-time spot market. The program has created $13 billion in direct payments to generators annually since 2015 and is now being implemented or considered in several major energy markets in the US and abroad. We assess the incentive's impact on the Texas market from three perspectives: First, we derive the incentive's equilibrium effect on the electricity price in a monopolistic market from first principles using a standard partial equilibrium economic model. We then empirically test whether the incentive encouraged net entry into the market or the generating applicant pool, controlling for market and climatic conditions using monthly capacity data. Finally, we look for direct evidence of an incentive response among active traders using real-time market trading data. The three approaches suggest buyers and producers cancel out the incentive, and the price-only program does not encourage new generation capacity to enter the market.


title: Over 600 V Lateral AlN-on-AlN Schottky Barrier Diodes with Ultra-Low Ideality Factor

abstract: This letter reports the demonstration of lateral AlN Schottky barrier diodes (SBDs) on single-crystal AlN substrates by metalorganic chemical vapor deposition (MOCVD) with an ultra-low ideality factor ({\eta}) of 1.65, a breakdown voltage (BV) of 640 V, and a record high normalized BV by the anode-to-cathode distance (LAC). The homoepitaxially grown AlN epilayers had much lower defect densities and excellent surface morphology, and the AlN ohmic contacts also showed improvements. At forward bias, the devices exhibited ultra-low {\eta} of 1.65 and high Schottky barrier height of 1.94 eV. The device current was dominated by thermionic emission, while most previously reported AlN SBDs suffered from defect-induced current with much higher {\eta} of >4. Additionally, the devices also had excellent rectifying characteristics with ON/OFF ratios on the order of 10^7 to 10^9 and excellent thermal stability from 298 to 573 K. At reverse bias, the devices showed a high BV of 640 V and record-high normalized breakdown voltage (BV/LAC) in lateral AlN SBDs. This work represents a big step towards high-performance ultra-wide bandgap AlN-based high-voltage and high-power devices.


title: Enhanced Robustness in Wireless Communications through Unified Sequency-Frequency Multiplexing

abstract: In the evolving wireless communications landscape, addressing the challenges of multipath fading and high mobility remains paramount. This paper introduces the Unified Sequency-Frequency Multiplexing (USFM) framework, a pioneering modulation scheme designed to significantly improve signal robustness and system performance by harnessing the integrated strengths of both sequency and frequency domains. At the heart of USFM lies the Joint Sequency-Frequency Transform (JSFT), a novel mathematical operation that seamlessly merges the characteristics of the Walsh-Hadamard Transform (WHT) and the Fast Fourier Transform (FFT). Through rigorous mathematical modeling, we delineate the theoretical foundation of USFM, supported by theorems and lemmas that underscore its potential to mitigate common channel impairments more effectively than existing modulation schemes. Furthermore, we propose an optimization process, guided by machine learning algorithms, to dynamically adapt the signal based on real-time Channel State Information (CSI), ensuring optimal performance under diverse conditions. Empirical simulations demonstrate the superior performance of USFM in scenarios characterized by Rayleigh fading and Doppler effects, highlighting its advantages in terms of error probability reduction and spectral efficiency. The USFM framework represents a significant leap forward in communication theory and offers practical implications for designing future wireless systems that require high reliability and adaptability.


title: Analysis of shear localization in viscoplastic solids with pressure-sensitive structural transformations

abstract: Localization, in the form of adiabatic shear, is analyzed in viscoplastic solids that may undergo structural transformation driven by pressure, shear stress, temperature, and magnetic field. As pertinent to polycrystalline metals, transformations may include solid-solid phase transitions, twinning, and dynamic recrystallization. A finite-strain constitutive framework for isotropic metals is used to solve a boundary value problem involving simple shearing with superposed hydrostatic pressure and constant external magnetic field. Three-dimensional theory is reduced to a formulation simple enough to facilitate approximate analytical solutions yet sophisticated enough to maintain the salient physics. Ranges of constitutive parameters (e.g., strain hardening, strain-rate sensitivity, thermal softening, and strain-driven structure transformation limits influenced by pressure and magnetic field) are obtained for which localization to infinite shear strain is possible. Motivated by experimental and theoretical studies suggesting a non-negligible role of shear on phase transformations in iron (Fe), the model is used to understand influences of pressure and phase transitions on applied strains for which localization should occur in pure Fe and a high-strength steel. Results show, among other trends for these two materials, that shear localization in conjunction with phase transformation is promoted when the transformed phase is softer than the parent phase. Localization that would occur in the isolated parent phase can be mitigated if the strain hardening or thermal softening tendencies of the transformed phase are sufficiently increased or reduced, respectively.


title: Stochastic Scheduling with Abandonments via Greedy Strategies

abstract: Motivated by applications where impatience is pervasive and service times are uncertain, we study a scheduling model where jobs may depart at an unknown point in time and service times are stochastic. Initially, we have access to a single server and $n$ jobs with known non-negative values: these jobs have unknown stochastic service and departure times with known distributional information, which we assume to be independent. When the server is free, we can run an available job which occupies the server for an unknown amount of time, and collect its value. The objective is to maximize the expected total value obtained from jobs run on the server. Natural formulations of this problem suffer from the curse of dimensionality. In fact, this problem is NP-hard even in the deterministic case. Hence, we focus on efficiently computable approximation algorithms that can provide high expected reward compared to the optimal expected value. Towards this end, we first provide a compact linear programming (LP) relaxation that gives an upper bound on the expected value obtained by the optimal policy. Then we design a polynomial-time algorithm that is nearly a $(1/2)\cdot (1-1/e)$-approximation to the optimal LP value (so also to the optimal expected value). We next shift our focus to the case of independent and identically distributed (i.i.d.) service times. In this case, we show that the greedy policy that always runs the highest-valued job whenever the server is free obtains a $1/2$-approximation to the optimal expected value. Our approaches extend effortlessly and we demonstrate their flexibility by providing approximations to natural extensions of our problem. Finally, we evaluate our LP-based policies and the greedy policy empirically on synthetic and real datasets.


title: Segmenting Dead Sea Scroll Fragments for a Scientific Image Set

abstract: This paper presents a customized pipeline for segmenting manuscript fragments from images curated by the Israel Antiquities Authority (IAA). The images present challenges for standard segmentation methods due to the presence of the ruler, color, and plate number bars, as well as a black background that resembles the ink and varying backing substrates. The proposed pipeline, consisting of four steps, addresses these challenges by isolating and solving each difficulty using custom tailored methods. Further, the usage of a multi-step pipeline will surely be helpful from a conceptual standpoint for other image segmentation projects that encounter problems that have proven intractable when applying any of the more commonly used segmentation techniques. In addition, we create a dataset with bar detection and fragment segmentation ground truth and evaluate the pipeline steps qualitatively and quantitatively on it. This dataset is publicly available to support the development of the field. It aims to address the lack of standard sets of fragment images and evaluation metrics and enable researchers to evaluate their methods in a reliable and reproducible manner.


title: The effect of separatrix density and PFC material on H-mode confinement in the ITPA global H-mode database

abstract: Recent data, added to the ITPA global H-mode database [1] for ASDEX-U [2] and JET-ILW, reveals that the separatrix density $n_{sep}$ has a correlation with the H20 factor (Confinement time relative to the ITPA20-IL scaling)[1]. These trends are analyzed in detail. They are not a result of proximity to the density limit. The normalized $n_{sepN} = n_{sep} / \bar{n}$ is introduced, motivated by theory ($\bar{n}$ is the average density). The trends in $n_{sepN}$ can be understood in terms of the two main mechanisms of pedestal characteristics -- MHD stability and recently developed theories of gyrokinetic transport. Careful analysis shows these mechanisms can be distinguished in the data. The most dramatic improvement in confinement time arises primarily from reductions in pedestal transport. A new definition of density peaking that includes core peaking is found to best explain H20 when advanced H-modes are included: $n_{sepN0} = n_{sep}/n(0)$, the inverse of the total density peaking from the separatrix to the axis. The highest H-factors are reached by the confluence of relatively low normalized $n_{sepN0}$ plus high Shafranov shift or poloidal beta. The importance of these two variables is also theoretically predicted from recent analysis of the gyrokinetic system, where a constraint can limit the access of ITG/TEM modes to free energy in equilibrium gradients. The Plasma Facing Component (PFC) material also shows a strong influence in the data. This is likely due to the importance of $n(0)/n_{sep}$ to attaining high H20, in conjunction with the known tendency for tungsten (W) to accumulate with density peaking and low transport. Preliminary results indicate that $n_{sepN0}$ might also be important with core ITBs.


title: Single-Temporal Supervised Learning for Universal Remote Sensing Change Detection

abstract: Bitemporal supervised learning paradigm always dominates remote sensing change detection using numerous labeled bitemporal image pairs, especially for high spatial resolution (HSR) remote sensing imagery. However, it is very expensive and labor-intensive to label change regions in large-scale bitemporal HSR remote sensing image pairs. In this paper, we propose single-temporal supervised learning (STAR) for universal remote sensing change detection from a new perspective of exploiting changes between unpaired images as supervisory signals. STAR enables us to train a high-accuracy change detector only using unpaired labeled images and can generalize to real-world bitemporal image pairs. To demonstrate the flexibility and scalability of STAR, we design a simple yet unified change detector, termed ChangeStar2, capable of addressing binary change detection, object change detection, and semantic change detection in one architecture. ChangeStar2 achieves state-of-the-art performances on eight public remote sensing change detection datasets, covering above two supervised settings, multiple change types, multiple scenarios. The code is available at https://github.com/Z-Zheng/pytorch-change-models.


title: SS-Bench: A Benchmark for Social Story Generation and Evaluation

abstract: Children with Autism Spectrum Disorder (ASD) often misunderstand social situations and struggle to participate in daily routines. Psychology experts write Social Stories under strict constraints of structural clarity, descriptive orientation, and situational safety to enhance their abilities in these regimes. However, Social Stories are costly in creation and often limited in diversity and timeliness. As Large Language Models (LLMs) become increasingly powerful, there is a growing need for more automated, affordable, and accessible methods to generate Social Stories in real-time with broad coverage. Adapting LLMs to meet the unique and strict constraints of Social Stories is a challenging issue. To this end, we propose \textbf{SS-Bench}, a \textbf{S}ocial \textbf{S}tory \textbf{Bench}mark for generating and evaluating Social Stories. Specifically, we develop a constraint-driven strategy named \textbf{\textsc{StarSow}} to hierarchically prompt LLMs to generate Social Stories and build a benchmark, which has been validated through experiments to fine-tune smaller models for generating qualified Social Stories. Additionally, we introduce \textbf{Quality Assessment Criteria}, employed in human and GPT evaluations, to verify the effectiveness of the generated stories. We hope this work benefits the autism community and catalyzes future research focusing on particular groups.


title: Functional photoacoustic noninvasive Doppler angiography in humans

abstract: Optical imaging of blood flow yields critical functional insights into the circulatory system, but its clinical implementation has typically been limited to shallow depths (~1 millimeter) due to light scattering in biological tissue. Here, we present photoacoustic noninvasive Doppler angiography (PANDA) for deep blood flow imaging. PANDA synergizes the photoacoustic and Doppler effects to generate color Doppler velocity and power Doppler blood flow maps of the vascular lumen. Our results demonstrate PANDA's ability to measure blood flow in vivo up to one centimeter in depth, marking approximately an order of magnitude improvement over existing high-resolution pure optical modalities. PANDA enhances photoacoustic flow imaging by increasing depth and enabling cross-sectional blood vessel imaging. We also showcase PANDA's clinical feasibility through three-dimensional imaging of blood flow in healthy subjects and a patient with varicose veins. By integrating the imaging system onto a mobile platform, we have designed PANDA to be a portable modality that is primed for expedient clinical translation. PANDA offers noninvasive, single modality imaging of hemoglobin and blood flow with three-dimensional capability, facilitating comprehensive assessment of deep vascular dynamics in humans.


title: On the topology of certain $13$-manifolds

abstract: This paper gives the classifications of certain $13$-manifolds up to diffeomorphism, homeomorphism, and homotopy equivalence, whose cohomology rings are isomorphic to $H^\ast(\mathrm{CP}^3\times S^7;\mathbb{Z})$.


title: Some ergodic theorems over $k$-full numbers

abstract: In 2022, Bergelson and Richter established a new dynamical generalization of the prime number theorem. Later, Loyd showed a disjoint form with the Erd\H{o}s-Kac theorem. Recently, the author and his coauthors proved some ergodic theorems over squarefree numbers related to these results. In this paper, building on the previous work, we will derive the analogues of Bergelson-Richter's theorem, Erd\H{o}s-Kac theorem and Loyd's theorem over $k$-full numbers for any integer $k\geq2$.


title: Self-Supervised Alignment Learning for Medical Image Segmentation

abstract: Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization. However, the spatial correspondence of 2D slices from a 3D medical image has not been fully exploited. In this paper, we propose a novel self-supervised alignment learning framework to pre-train the neural network for medical image segmentation. The proposed framework consists of a new local alignment loss and a global positional loss. We observe that in the same 3D scan, two close 2D slices usually contain similar anatomic structures. Thus, the local alignment loss is proposed to make the pixel-level features of matched structures close to each other. Experimental results show that the proposed alignment learning is competitive with existing self-supervised pre-training approaches on CT and MRI datasets, under the setting of limited annotations.


title: Mixture of Directed Graphical Models for Discrete Spatial Random Fields

abstract: Current approaches for modeling discrete-valued outcomes associated with spatially-dependent areal units incur computational and theoretical challenges, especially in the Bayesian setting when full posterior inference is desired. As an alternative, we propose a novel statistical modeling framework for this data setting, namely a mixture of directed graphical models (MDGMs). The components of the mixture, directed graphical models, can be represented by directed acyclic graphs (DAGs) and are computationally quick to evaluate. The DAGs representing the mixture components are selected to correspond to an undirected graphical representation of an assumed spatial contiguity/dependence structure of the areal units, which underlies the specification of traditional modeling approaches for discrete spatial processes such as Markov random fields (MRFs). We introduce the concept of compatibility to show how an undirected graph can be used as a template for the structural dependencies between areal units to create sets of DAGs which, as a collection, preserve the structural dependencies represented in the template undirected graph. We then introduce three classes of compatible DAGs and corresponding algorithms for fitting MDGMs based on these classes. In addition, we compare MDGMs to MRFs and a popular Bayesian MRF model approximation used in high-dimensional settings in a series of simulations and an analysis of ecometrics data collected as part of the Adolescent Health and Development in Context Study.


title: High-Efficiency Low-Noise Optomechanical Crystal Photon-Phonon Transducers

abstract: Optomechanical crystals (OMCs) enable coherent interactions between optical photons and microwave acoustic phonons, and represent a platform for implementing quantum transduction between microwave and optical signals. Optical absorption-induced thermal noise at cryogenic (millikelvin) temperatures is one of the primary limitations of performance for OMC-based quantum transducers. Here, we address this challenge with a two-dimensional silicon OMC resonator that is side-coupled to a mechanically detached optical waveguide, realizing a six-fold reduction in the heating rate of the acoustic resonator compared to prior state-of-the-art, while operating in a regime of high optomechanical-backaction and millikelvin base temperature. This reduced heating translates into a demonstrated phonon-to-photon conversion efficiency of 93.1 $\pm$ 0.8% at an added noise of 0.25 $\pm$ 0.01 quanta, representing a significant advance toward quantum-limited microwave-optical frequency conversion and optically-controlled quantum acoustic memories.


title: Testing for Restricted Stochastic Dominance under Survey Nonresponse with Panel Data: Theory and an Evaluation of Poverty in Australia

abstract: This paper lays the groundwork for a unifying approach to stochastic dominance testing under survey nonresponse that integrates the partial identification approach to incomplete data and design-based inference for complex survey data. We propose a novel inference procedure for restricted $s$th-order stochastic dominance, tailored to accommodate a broad spectrum of nonresponse assumptions. The method uses pseudo-empirical likelihood to formulate the test statistic and compares it to a critical value from the chi-squared distribution with one degree of freedom. We detail the procedure's asymptotic properties under both null and alternative hypotheses, establishing its uniform validity under the null and consistency against various alternatives. Using the Household, Income and Labour Dynamics in Australia survey, we demonstrate the procedure's utility in a sensitivity analysis of temporal poverty comparisons among Australian households.


title: The Simons Observatory: Deployment of the observatory control system and supporting infrastructure

abstract: The Simons Observatory (SO) is a cosmic microwave background (CMB) observatory consisting of three small aperture telescopes and one large aperture telescope. SO is located in the Atacama Desert in Chile at an elevation of 5180m. Distributed among the four telescopes are over 60,000 transition-edge sensor (TES) bolometers across six spectral bands centered between 27 and 280 GHz. A large collection of ancillary hardware devices which produce lower rate `housekeeping' data are used to support the detector data collection. We developed a distributed control system, which we call the observatory control system (ocs), to coordinate data collection among all systems within the observatory. ocs is a core component of the deployed site software, interfacing with all on-site hardware. Alongside ocs we utilize a combination of internally and externally developed open source projects to enable remote monitoring, data management, observation coordination, and data processing. Deployment of a majority of the software is done using Docker containers. The deployment of software packages is partially done via automated Ansible scripts, utilizing a GitOps based approach for updating infrastructure on site. We describe an overview of the software and computing systems deployed within SO, including how those systems are deployed and interact with each other. We also discuss the timing distribution system and its configuration as well as lessons learned during the deployment process and where we plan to make future improvements.


title: video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models

abstract: Speech understanding as an element of the more generic video understanding using audio-visual large language models (av-LLMs) is a crucial yet understudied aspect. This paper proposes video-SALMONN, a single end-to-end av-LLM for video processing, which can understand not only visual frame sequences, audio events and music, but speech as well. To obtain fine-grained temporal information required by speech understanding, while keeping efficient for other video elements, this paper proposes a novel multi-resolution causal Q-Former (MRC Q-Former) structure to connect pre-trained audio-visual encoders and the backbone large language model. Moreover, dedicated training approaches including the diversity loss and the unpaired audio-visual mixed training scheme are proposed to avoid frames or modality dominance. On the introduced speech-audio-visual evaluation benchmark, video-SALMONN achieves more than 25\% absolute accuracy improvements on the video-QA task and over 30\% absolute accuracy improvements on audio-visual QA tasks with human speech. In addition, video-SALMONN demonstrates remarkable video comprehension and reasoning abilities on tasks that are unprecedented by other av-LLMs. Our training code and model checkpoints are available at \texttt{\url{https://github.com/bytedance/SALMONN/}}.


title: On the minimal number of closed geodesics on positively curved Finsler spheres

abstract: In this paper, we proved that for every Finsler metric on $S^n$ $(n\ge 4)$ with reversibility $\lambda$ and flag curvature $K$ satisfying $(\frac{2n-3}{n-1})^2 (\frac{\lambda}{\lambda+1})^2<K\le 1$ and $ \lambda<\frac{n-1}{n-2} $, there exist at least $n$ prime closed geodesics on $(S^n,F)$, which solved a conjecture of Katok and Anosov for such positivley curved spheres when $n$ is even. Furthermore, if the number of closed geodesics on such positively curved Finsler $S^n$ is finite, then there exist at least $2\left[\frac{n}{2}\right]-1$ non-hyperbolic closed geodesics.


title: In Memoriam: Peter Higgs (1929-2024)

abstract: Peter Higgs was a British theoretical physicist, famous for his work published in 1964, where he proposed a mechanism that can generate masses for elementary particles, while respecting gauge invariance. Half a century later, two experiments at CERN confirmed that this mechanism is realized in nature. On April 8th, we received the sad news of the passing of the great pioneer of elementary particle physics. This article is dedicated to his memory, and to the mechanism and particle that bear his name. -- Peter Higgs fue un f\'isico te\'orico brit\'anico, famoso por su trabajo de 1964 donde propuso un mecanismo que puede generar masas para part\'iculas elementales, conforme a la simetr\'ia de norma. Medio siglo m\'as tarde, dos experimentos del CERN confirmaron que este mecanismo est\'a realizado en la naturaleza. El 8 de abril nos lleg\'o la triste noticia del fallecimiento del gran pionero de la fisica de part\'iculas elementales. Este art\'iculo es dedicado a su memoria, as\'i como al mecanismo y a la part\'icula que llevan su nombre.


title: psPRF:Pansharpening Planar Neural Radiance Field for Generalized 3D Reconstruction Satellite Imagery

abstract: Most current NeRF variants for satellites are designed for one specific scene and fall short of generalization to new geometry. Additionally, the RGB images require pan-sharpening as an independent preprocessing step. This paper introduces psPRF, a Planar Neural Radiance Field designed for paired low-resolution RGB (LR-RGB) and high-resolution panchromatic (HR-PAN) images from satellite sensors with Rational Polynomial Cameras (RPC). To capture the cross-modal prior from both of the LR-RGB and HR-PAN images, for the Unet-shaped architecture, we adapt the encoder with explicit spectral-to-spatial convolution (SSConv) to enhance the multimodal representation ability. To support the generalization ability of psRPF across scenes, we adopt projection loss to ensure strong geometry self-supervision. The proposed method is evaluated with the multi-scene WorldView-3 LR-RGB and HR-PAN pairs, and achieves state-of-the-art performance.


title: Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimization

abstract: Large language models have demonstrated remarkable capabilities, but their performance is heavily reliant on effective prompt engineering. Automatic prompt optimization (APO) methods are designed to automate this and can be broadly categorized into those targeting instructions (instruction optimization, IO) vs. those targeting exemplars (exemplar selection, ES). Despite their shared objective, these have evolved rather independently, with IO recently receiving more research attention. This paper seeks to bridge this gap by comprehensively comparing the performance of representative IO and ES techniques, both isolation and combination, on a diverse set of challenging tasks. Our findings reveal that intelligently reusing model-generated input-output pairs obtained from evaluating prompts on the validation set as exemplars consistently improves performance over IO methods but is currently under-investigated. We also find that despite the recent focus on IO, how we select exemplars can outweigh how we optimize instructions, with ES strategies as simple as random search outperforming state-of-the-art IO methods with seed instructions without any optimization. Moreover, we observe synergy between ES and IO, with optimal combinations surpassing individual contributions. We conclude that studying exemplar selection as a standalone method and its optimal combination with instruction optimization remains a crucial aspect of APO and deserves greater consideration in future research, even in the era of highly capable instruction-following models.


title: I Experienced More than 10 DeFi Scams: On DeFi Users' Perception of Security Breaches and Countermeasures

abstract: Decentralized Finance (DeFi) offers a whole new investment experience and has quickly emerged as an enticing alternative to Centralized Finance (CeFi). Rapidly growing market size and active users, however, have also made DeFi a lucrative target for scams and hacks, with 1.95 billion USD lost in 2023. Unfortunately, no prior research thoroughly investigates DeFi users' security risk awareness levels and the adequacy of their risk mitigation strategies. Based on a semi-structured interview study (N = 14) and a follow-up survey (N = 493), this paper investigates DeFi users' security perceptions and commonly adopted practices, and how those affected by previous scams or hacks (DeFi victims) respond and try to recover their losses. Our analysis shows that users often prefer DeFi over CeFi due to their decentralized nature and strong profitability. Despite being aware that DeFi, compared to CeFi, is prone to more severe attacks, users are willing to take those risks to explore new investment opportunities. Worryingly, most victims do not learn from previous experiences; unlike victims studied through traditional systems, DeFi victims tend to find new services, without revising their security practices, to recover their losses quickly. The abundance of various DeFi services and opportunities allows victims to continuously explore new financial opportunities, and this reality seems to cloud their security priorities. Indeed, our results indicate that DeFi users' strong financial motivations outweigh their security concerns - much like those who are addicted to gambling. Our observations about victims' post-incident behaviors suggest that stronger control in the form of industry regulations would be necessary to protect DeFi users from future breaches.


title: A photonic quantum engine driven by superradiance

abstract: Performance of nano- and micro-scale heat engines can be improved with a help from quantum mechanical phenomena. Recently, heat reservoirs with quantum coherence have been proposed to enhance engine performance beyond the Carnot limit even with a single reservoir. However, no physical realizations have been achieved so far. Here, we report the first proof-of-principle experimental demonstration of a photonic quantum engine driven by superradiance employing a single heat reservoir composed of atoms and photonic vacuum. Reservoir atoms prepared in a quantum coherent superposition state underwent superradiance while traversing the cavity. This led to about 40-fold increase of the effective engine temperature, resulting in a near-unity engine efficiency. Moreover, the observed engine output power grew quadratically with respect to the atomic injection rate. Our work can be utilized in quantum mechanical heat transfer as well as in boosting engine powers, opening a pathway to development of photomechanical devices that run on quantum coherence embedded in heat baths.


title: Parameterized quasinormal frequencies and Hawking radiation for axial gravitational perturbations of a holonomy-corrected black hole

abstract: As the fingerprints of black holes, quasinormal modes are closely associated with many properties of black holes. Especially, the ringdown phase of gravitational waveforms from the merger of compact binary components can be described by quasinormal modes. Serving as a model-independent approach, the framework of parameterized quasinormal frequencies offers a universal method for investigating quasinormal modes of diverse black holes. In this work, we first obtain the Schr\"{o}dinger-like master equation of the axial gravitational perturbation of a holonomy-corrected black hole. We calculate the corresponding quasinormal frequencies using the Wentzel-Kramers-Brillouin approximation and asymptotic iteration methods. We investigate the numerical evolution of an initial wave packet on the background spacetime. Then, we deduce the parameterized expression of the quasinormal frequencies and find that $r_0 \leq 10^{-2}$ is a necessary condition for the parameterized approximation to be valid. We also study the impact of the quantum parameter $r_0$ on the greybody factor and Hawking radiation. With more ringdown signals of gravitational waves detected in the future, our research will contribute to the study of the quantum properties of black holes.


title: Construction and Accuracy of Electronic Continuum Models of Incommensurate Bilayer 2D Materials

abstract: Single-particle continuum models such as the popular Bistritzer-MacDonald model have become powerful tools for predicting electronic phenomena of incommensurate 2D materials and the development of many-body models aimed to model unconventional superconductivity and correlated insulators. In this work, we introduce a procedure to construct continuum models of arbitrary accuracy relative to tight-binding models for moir\'{e} incommensurate bilayers. This is done by recognizing the continuum model as arising from Taylor expansions of a high accuracy momentum space approximation of the tight-binding model. We apply our procedure in full detail to two models of twisted bilayer graphene and demonstrate both admit the Bistritzer-MacDonald model as the leading order continuum model, while higher order expansions reveal qualitative spectral differences.


title: Efficient Low-rank Identification via Accelerated Iteratively Reweighted Nuclear Norm Minimization

abstract: This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the nonconvex low-rank minimization problem. Two major novelties characterize our approach. Firstly, the proposed method possesses a rank identification property, enabling the provable identification of the "correct" rank of the stationary point within a finite number of iterations. Secondly, we introduce an adaptive updating strategy for smoothing parameters. This strategy automatically fixes parameters associated with zero singular values as constants upon detecting the "correct" rank while quickly driving the rest of the parameters to zero. This adaptive behavior transforms the algorithm into one that effectively solves smooth problems after a few iterations, setting our work apart from existing iteratively reweighted methods for low-rank optimization. We prove the global convergence of the proposed algorithm, guaranteeing that every limit point of the iterates is a critical point. Furthermore, a local convergence rate analysis is provided under the Kurdyka-{\L}ojasiewicz property. We conduct numerical experiments using both synthetic and real data to showcase our algorithm's efficiency and superiority over existing methods.


title: Fast, optimal, and dynamic electoral campaign budgeting by a generalized Colonel Blotto game

abstract: The Colonel Blotto game is a deeply studied theoretical model for competitive allocation environments including elections, advertising, and ecology. However, the original formulation of Colonel Blotto has had few practical implications due to the lack of fast algorithms to compute its optimal strategies and the limited applicability of its winner-take-all reward distribution. We demonstrate that the Colonel Blotto game can be a practical model for competitive allocation environments by implementing the multiplicative weights update algorithm from Beaglehole et al. (2023). In particular, using that this algorithm allows for arbitrary winning-rules, we study strategies for a more realistic model of political campaigning we term Electoral Colonel Blotto. Contrary to existing theory and the implemented allocation strategies from U.S. presidential elections, we find that the optimal response to Democratic and Republican strategies in the 2008 and 2020 presidential elections was to focus allocations on a subset of states and sacrifice winning probability on others. We also found that campaigners should compete for undecided voters even in states where the opponent has significantly many more decided voters.


title: $L^q$ Estimates on the Restriction of Schr\"odinger Eigenfunctions with singular potentials

abstract: We consider eigenfunction estimates in $L^p$ for Schr\"odinger operators, $H_V=-\Delta_g+V(x)$, on compact Riemannian manifolds $(M, g)$. Eigenfunction estimates over the full manifolds were already obtained by Sogge \cite{Sogge1988concerning} for $V\equiv 0$ and the first author, Sire, and Sogge \cite{BlairSireSogge2021Quasimode}, and the first author, Huang, Sire, and Sogge \cite{BlairHuangSireSogge2022UniformSobolev} for critically singular potentials $V$. For the corresponding restriction estimates for submanifolds, the case $V\equiv 0$ was considered in Burq, G\'erard, and Tzvetkov \cite{BurqGerardTzvetkov2007restrictions}, and Hu \cite{Hu2009lp}. In this article, we will handle eigenfunction restriction estimates for some submanifolds $\Sigma$ on compact Riemannian manifolds $(M, g)$ with $n:=\dim M\geq 2$, where $V$ is a singular potential.


title: Predicting fluorescent labels in label-free microscopy images with pix2pix and adaptive loss in Light My Cells challenge

abstract: Fluorescence labeling is the standard approach to reveal cellular structures and other subcellular constituents for microscopy images. However, this invasive procedure may perturb or even kill the cells and the procedure itself is highly time-consuming and complex. Recently, in silico labeling has emerged as a promising alternative, aiming to use machine learning models to directly predict the fluorescently labeled images from label-free microscopy. In this paper, we propose a deep learning-based in silico labeling method for the Light My Cells challenge. Built upon pix2pix, our proposed method can be trained using the partially labeled datasets with an adaptive loss. Moreover, we explore the effectiveness of several training strategies to handle different input modalities, such as training them together or separately. The results show that our method achieves promising performance for in silico labeling. Our code is available at https://github.com/MedICL-VU/LightMyCells.


title: Theory of excitonic complexes in gated WSe$_2$ quantum dots

abstract: Single-layer quantum dot gate potential causes type-II band alignment, i.e. electrostatically confines holes and repels electrons, or vice versa. Hence, the confinement of excitons in gated type II quantum dots involves a delicate balance of the repulsion of electrons due to the gate potential with the attraction caused by the Coulomb interaction with a hole localized in the quantum dot. This work presents a theory for neutral excitonic complexes within gated $\text{WSe}_\text{2}$ quantum dots, considering spin, valley, electronic orbitals, and many-body interactions. We analyze how the electron-hole attraction depends on a range of system parameters, such as screened Coulomb interaction, strength of confinement of holes, and repulsion of electrons. Using an atomistic tight binding model we compute valence and conduction band states within a computational box comprising over one million atoms with applied gate potential. The atomistic wavefunctions are then used to calculate direct and exchange Coulomb matrix elements for a fictitious type I quantum dot, and to obtain a spectrum of interacting electron-hole pairs. Next, we study the effect of repulsive potential, pulling away electrons from the valence hole. We determine whether electron-hole pairs are sufficiently attracted to overcome electron repulsion by the confinement potential. Finally, we compute the dipole transition between hole and electron states to obtain the absorption spectrum.


title: Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models

abstract: As large language models (LLMs) increasingly permeate daily lives, there is a growing demand for real-time interactions that mirror human conversations. Traditional turn-based chat systems driven by LLMs prevent users from verbally interacting with the system while it is generating responses. To overcome these limitations, we adapt existing LLMs to \textit{duplex models} so that these LLMs can listen for users while generating output and dynamically adjust themselves to provide users with instant feedback. % such as in response to interruptions. Specifically, we divide the queries and responses of conversations into several time slices and then adopt a time-division-multiplexing (TDM) encoding-decoding strategy to pseudo-simultaneously process these slices. Furthermore, to make LLMs proficient enough to handle real-time conversations, we build a fine-tuning dataset consisting of alternating time slices of queries and responses as well as covering typical feedback types in instantaneous interactions. Our experiments show that although the queries and responses of conversations are segmented into incomplete slices for processing, LLMs can preserve their original performance on standard benchmarks with a few fine-tuning steps on our dataset. Automatic and human evaluation indicate that duplex models make user-AI interactions more natural and human-like, and greatly improve user satisfaction compared to vanilla LLMs. Our duplex model and dataset will be released.


title: How to Learn More? Exploring Kolmogorov-Arnold Networks for Hyperspectral Image Classification

abstract: Convolutional Neural Networks (CNNs) and vision transformers (ViTs) have shown excellent capability in complex hyperspectral image (HSI) classification. However, these models require a significant number of training data and are computational resources. On the other hand, modern Multi-Layer Perceptrons (MLPs) have demonstrated great classification capability. These modern MLP-based models require significantly less training data compared to CNNs and ViTs, achieving the state-of-the-art classification accuracy. Recently, Kolmogorov-Arnold Networks (KANs) were proposed as viable alternatives for MLPs. Because of their internal similarity to splines and their external similarity to MLPs, KANs are able to optimize learned features with remarkable accuracy in addition to being able to learn new features. Thus, in this study, we assess the effectiveness of KANs for complex HSI data classification. Moreover, to enhance the HSI classification accuracy obtained by the KANs, we develop and propose a Hybrid architecture utilizing 1D, 2D, and 3D KANs. To demonstrate the effectiveness of the proposed KAN architecture, we conducted extensive experiments on three newly created HSI benchmark datasets: QUH-Pingan, QUH-Tangdaowan, and QUH-Qingyun. The results underscored the competitive or better capability of the developed hybrid KAN-based model across these benchmark datasets over several other CNN- and ViT-based algorithms, including 1D-CNN, 2DCNN, 3D CNN, VGG-16, ResNet-50, EfficientNet, RNN, and ViT. The code are publicly available at (https://github.com/aj1365/HSIConvKAN)


title: Scaling Laws for Fact Memorization of Large Language Models

abstract: Fact knowledge memorization is crucial for Large Language Models (LLM) to generate factual and reliable responses. However, the behaviors of LLM fact memorization remain under-explored. In this paper, we analyze the scaling laws for LLM's fact knowledge and LLMs' behaviors of memorizing different types of facts. We find that LLMs' fact knowledge capacity has a linear and negative exponential law relationship with model size and training epochs, respectively. Estimated by the built scaling law, memorizing the whole Wikidata's facts requires training an LLM with 1000B non-embed parameters for 100 epochs, suggesting that using LLMs to memorize all public facts is almost implausible for a general pre-training setting. Meanwhile, we find that LLMs can generalize on unseen fact knowledge and its scaling law is similar to general pre-training. Additionally, we analyze the compatibility and preference of LLMs' fact memorization. For compatibility, we find LLMs struggle with memorizing redundant facts in a unified way. Only when correlated facts have the same direction and structure, the LLM can compatibly memorize them. This shows the inefficiency of LLM memorization for redundant facts. For preference, the LLM pays more attention to memorizing more frequent and difficult facts, and the subsequent facts can overwrite prior facts' memorization, which significantly hinders low-frequency facts memorization. Our findings reveal the capacity and characteristics of LLMs' fact knowledge learning, which provide directions for LLMs' fact knowledge augmentation.


abstract: Variational quantum algorithms (VQAs) show potential for quantum advantage in the near term of quantum computing, but demand a level of accuracy that surpasses the current capabilities of NISQ devices. To systematically mitigate the impact of quantum device error on VQAs, we propose Clapton: Clifford-Assisted Problem Transformation for Error Mitigation in Variational Quantum Algorithms. Clapton leverages classically estimated good quantum states for a given VQA problem, classical simulable models of device noise, and the variational principle for VQAs. It applies transformations on the VQA problem's Hamiltonian to lower the energy estimates of known good VQA states in the presence of the modeled device noise. The Clapton hypothesis is that as long as the known good states of the VQA problem are close to the problem's ideal ground state and the device noise modeling is reasonably accurate (both of which are generally true), then the Clapton transformation substantially decreases the impact of device noise on the ground state of the VQA problem, thereby increasing the accuracy of the VQA solution. Clapton is built as an end-to-end application-to-device framework and achieves mean VQA initialization improvements of 1.7x to 3.7x, and up to a maximum of 13.3x, over the state-of-the-art baseline when evaluated for a variety of scientific applications from physics and chemistry on noise models and real quantum devices.


title: Stress-tunable abilities of glass forming and mechanical amorphization

abstract: Mechanical amorphization, a widely observed phenomenon, has been utilized to synthesize novel phases by inducing disorder through external loading, thereby expanding the realm of glass-forming systems. Empirically, it has been plausible that mechanical amorphization ability consistently correlates with glass-forming ability. However, through a comprehensive investigation in binary, ternary, and quaternary systems combining neutron diffraction, calorimetric experimental approaches and molecular dynamics simulation, we demonstrate that this impression is only partly true and we reveal that the mechanical amorphization ability can be inversely correlated with the glass forming ability in certain cases To provide insights into these intriguing findings, we present a stress-dependent nucleation theory that offers a coherent explanation for both experimental and simulation results. Our study identifies the intensity of mechanical work, contributed by external stress, as the key control parameter for mechanical amorphization, rendering the ability to tune this process. This discovery not only unravels the underlying correlation between mechanical amorphization and glass-forming ability but also provides a pathway for the design and discovery of new amorphous phases with tailored properties.


title: Acoustic Feature Mixup for Balanced Multi-aspect Pronunciation Assessment

abstract: In automated pronunciation assessment, recent emphasis progressively lies on evaluating multiple aspects to provide enriched feedback. However, acquiring multi-aspect-score labeled data for non-native language learners' speech poses challenges; moreover, it often leads to score-imbalanced distributions. In this paper, we propose two Acoustic Feature Mixup strategies, linearly and non-linearly interpolating with the in-batch averaged feature, to address data scarcity and score-label imbalances. Primarily using goodness-of-pronunciation as an acoustic feature, we tailor mixup designs to suit pronunciation assessment. Further, we integrate fine-grained error-rate features by comparing speech recognition results with the original answer phonemes, giving direct hints for mispronunciation. Effective mixing of the acoustic features notably enhances overall scoring performances on the speechocean762 dataset, and detailed analysis highlights our potential to predict unseen distortions.


title: Monte Carlo study of frustrated Ising model with nearest- and next-nearest-neighbor interactions in generalized triangular lattices

abstract: We investigate the frustrated $J_1$-$J_2$ Ising model with nearest-neighbor interaction $J_1$ and next-nearest-neighbor interaction $J_2$ in two kinds of generalized triangular lattices (GTLs) employing the Wang--Landau Monte Carlo method and finite-size scaling analysis. In the first GTL (GTL1), featuring anisotropic properties, we identify three kinds of super-antiferromagnetic ground states with stripe structures. Meanwhile, in the second GTL (GTL2), which is non-regular in next-nearest-neighbor interaction, the ferrimagnetic 3$\times$3 and two kinds of partial spin liquid ground states are observed. We confirm that residual entropy is proportional to the number of spins in the partial spin liquid ground states. Additionally, we construct finite-temperature phase diagrams for ferromagnetic nearest-neighbor and antiferromagnetic next-nearest-neighbor interactions. In GTL1, the transition into the ferromagnetic phase is continuous, contrasting with the first-order transition into the stripe phase. In GTL2, the critical temperature into the ferromagnetic ground state decreases as antiferromagnetic next-nearest-neighbor interaction intensifies until it meets the 3$\times$3 phase boundary. For intermediate values of the next-nearest-neighbor interaction, two successive transitions emerge: one from the paramagnetic phase to the ferromagnetic phase, followed by the other transition from the ferromagnetic phase to the 3$\times$3 phase.


title: Self Training and Ensembling Frequency Dependent Networks with Coarse Prediction Pooling and Sound Event Bounding Boxes

abstract: To tackle sound event detection (SED) task, we propose frequency dependent networks (FreDNets), which heavily leverage frequency-dependent methods. We apply frequency warping and FilterAugment, which are frequency-dependent data augmentation methods. The model architecture consists of 3 branches: audio teacher-student transformer (ATST) branch, BEATs branch and CNN branch including either partial dilated frequency dynamic convolution (PDFD) or squeeze-and-Excitation (SE) with time-frame frequency-wise SE (tfwSE). To train MAESTRO labels with coarse temporal resolution, we apply max pooling on prediction for the MAESTRO dataset. Using best ensemble model, we apply self training to obtain pseudo label from DESED weak set, DESED unlabeled set and AudioSet. AudioSet labels are filtered to focus on high-confidence pseudo labels and AudioSet pseudo labels are used to train on DESED labels only. We used change-detection-based sound event bounding boxes (cSEBBs) as post processing for ensemble models on self training and submission models.


title: Revisiting nonequilibrium characterization of glass: History dependence in solids

abstract: Glass has long been considered a nonequilibrium material. The primary reason is its history-dependent properties: the obtained properties are not uniquely determined by two state variables alone, namely, temperature and volume, but are affected by the process parameters, such as cooling rates. However, closer observations show that this history dependence is common in solid; in crystal growth, the properties of an obtained crystal are affected by the preparation conditions through defect structures and metallurgical structures. The problem with the previous reasoning of history dependence lies in the lack of appropriate specification of state variables. Without knowledge of the latter, describing thermodynamic states is impossible. The guiding principle to find state variables is provided by the first law of thermodynamics. The state variables of solids have been searched by requiring that the internal energy $U$ is a state function. Detailed information about the abovementioned microstructures is needed to describe the state function $U$. This can be accomplished by specifying the time-averaged positions R_{j} of all atoms comprising the solids. Therefore, R_{j} is a state variable for solids. Defect states, being metastable states, represent equilibrium states within a finite time (relaxation time). However, eternal equilibrium is nonexistent: the perfect crystal is thermodynamically unstable. Equilibrium states can only be considered at the local level. Glass is thus in equilibrium as long as its structure does not change. The relaxation time is controlled by the energy barriers by which a structure is sustained, and this time restriction is intimately related to the definition of state variables. The most important property of state variables is their invariance to time averaging. The time-averaged quantity R_{j} meets this invariance property.


title: Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images

abstract: Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment at the cellular level. Current state-of-the-art multiplexed immunofluorescence image analysis pipelines depend on cell feature representations characterised by morphological and stain intensity-based metrics generated using simple statistical and machine learning-based tools. However, these methods are not capable of generating complex representations of cells. We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision using a latent subspace to extract cell features in mIF images. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients, to demonstrate the success of our model against current and alternative methods.


title: Homogenization of semilinear parabolic PDEs with the third boundary conditions

abstract: In this paper, we study the homogenization of the third boundary value problem for semilinear parabolic PDEs with rapidly oscillating periodic coefficients in the weak sense. Our method is entirely probabilistic, and builds upon the work of [28] and [3]. Backward stochastic differential equations with singular coefficients play an important role in our approach.


title: ALMA follow-up of $\sim$ 3,000 red-Herschel galaxies: the nature of extreme submillimeter galaxies

abstract: We present the analysis of over 3,000 red-$Herschel$ sources ($S_{\mathrm{250\mu m}}<S_{\mathrm{350\mu m}}<S_{\mathrm{500\mu m} }$) using public data from the ALMA archive and the $Herschel$-ATLAS survey. This represents the largest sample of red-$Herschel$ sources with interferometric follow-up observations to date. The high ALMA angular resolution and sensitivity ($\theta_{\rm FWHM}\sim$1 arcsecond; $\sigma_{1.3\mathrm{mm}}\sim0.17$ mJy beam$^{-1}$) allow us to classify the sample into individual sources, multiple systems, and potential lenses and/or close mergers. Interestingly, even at this high angular resolution, 73 per cent of our detections are single systems, suggesting that most of these galaxies are isolated and/or post-merger galaxies. For the remaining detections, 20 per cent are classified as multiple systems, 5 per cent as lenses and/or mergers, and 2 per cent as low-$z$ galaxies or Active Galactic Nuclei. Combining the $Herschel$/SPIRE and ALMA photometry, these galaxies are found to be extreme and massive systems with a median star formation rate of $\sim$ 1,500 $\mathrm{M_{\odot} yr^{-1}}$ and molecular gas mass of $M_{\mathrm{gas}}\sim10^{11}$ $\mathrm{M_{\odot}}$. The median redshift of individual sources is $z\approx2.8$, while the likely lensed systems are at $z\approx3.3$, with redshift distributions extending to $z\sim6$. The inferred depletion times are consistent with the starburst-type population with a mild redshift evolution. Our results suggest a common star-formation mode for extreme galaxies across cosmic time, likely triggered by close interactions or disk-instabilities. Moreover, all galaxies with $S_{\mathrm{1.3mm}}\geq13$ mJy are gravitationally amplified which, similar to the established $S_{500\mathrm{ \mu m}}>100$ mJy threshold, can be used as a simple criterion to identify gravitationally lensed galaxies.


title: Proton discrimination in CLYC for fast neutron spectroscopy

abstract: The Cs$_2$LiYCl$_6$:Ce (CLYC) elpasolite scintillator is known for its response to fast and thermal neutrons along with good $\gamma$-ray energy resolution. While the $^{35}$Cl($n,p$) reaction has been identified as a potential means for CLYC-based fast neutron spectroscopy in the absence of time-of-flight (TOF), previous efforts to functionalize CLYC as a fast neutron spectrometer have been thwarted by the inability to isolate proton interactions from $^{6}$Li($n,\alpha$) and $^{35}$Cl($n,\alpha$) signals. This work introduces a new approach to particle discrimination in CLYC for fission spectrum neutrons using a multi-gate charge integration algorithm that provides excellent separation between protons and heavier charged particles. Neutron TOF data were collected using a $^{252}$Cf source, an array of EJ-309 organic liquid scintillators, and a $^6$Li-enriched CLYC scintillator outfitted with fast electronics. Modal waveforms were constructed corresponding to the different reaction channels, revealing significant differences in the pulse characteristics of protons and heavier charged particles at ultrafast, fast, and intermediate time scales. These findings informed the design of a pulse shape discrimination algorithm, which was validated using the TOF data. This study also proposes an iterative subtraction method to mitigate contributions from confounding reaction channels in proton and heavier charged particle pulse height spectra, opening the door for CLYC-based fast neutron and $\gamma$-ray spectroscopy while preserving sensitivity to thermal neutron capture signals.


title: Breaking Secure Aggregation: Label Leakage from Aggregated Gradients in Federated Learning

abstract: Federated Learning (FL) exhibits privacy vulnerabilities under gradient inversion attacks (GIAs), which can extract private information from individual gradients. To enhance privacy, FL incorporates Secure Aggregation (SA) to prevent the server from obtaining individual gradients, thus effectively resisting GIAs. In this paper, we propose a stealthy label inference attack to bypass SA and recover individual clients' private labels. Specifically, we conduct a theoretical analysis of label inference from the aggregated gradients that are exclusively obtained after implementing SA. The analysis results reveal that the inputs (embeddings) and outputs (logits) of the final fully connected layer (FCL) contribute to gradient disaggregation and label restoration. To preset the embeddings and logits of FCL, we craft a fishing model by solely modifying the parameters of a single batch normalization (BN) layer in the original model. Distributing client-specific fishing models, the server can derive the individual gradients regarding the bias of FCL by resolving a linear system with expected embeddings and the aggregated gradients as coefficients. Then the labels of each client can be precisely computed based on preset logits and gradients of FCL's bias. Extensive experiments show that our attack achieves large-scale label recovery with 100\% accuracy on various datasets and model architectures.


title: AI-Driven Approaches for Optimizing Power Consumption: A Comprehensive Survey

abstract: Reduced environmental effect, lower operating costs, and a stable and sustainable energy supply for current and future generations are the main reasons why power optimization is important. Power optimization makes ensuring that energy is used more effectively, cutting down on waste and optimizing the utilization of resources.In today's world, power optimization and artificial intelligence (AI) integration are essential to changing the way energy is produced, used, and distributed. Real-time monitoring and analysis of power usage trends is made possible by AI-driven algorithms and predictive analytics, which enable dynamic modifications to effectively satisfy demand. Efficiency and sustainability are increased when power consumption is optimized in different sectors thanks to the use of intelligent systems. This survey paper comprises an extensive review of the several AI techniques used for power optimization as well as a methodical analysis of the literature for the study of various intelligent system application domains across different disciplines of power consumption.This literature review identifies the performance and outcomes of 17 different research methods by assessing them, and it aims to distill valuable insights into their strengths and limitations. Furthermore, this article outlines future directions in the integration of AI for power consumption optimization.


title: Active and inactive contributions to the wall pressure and wall-shear stress in turbulent boundary layers

abstract: A phenomenological description is presented to explain the low-frequency/large-scale contributions to the wall-shear-stress (${\tau}_w$) and wall-pressure (${p}_w$) spectra of canonical turbulent boundary layers, which are well known to increase with Reynolds number. The explanation is based on the concept of active and inactive motions (Townsend, J. Fluid Mech., vol. 11, 1961) associated with the attached-eddy hypothesis. Unique data sets of simultaneously acquired ${\tau}_w$, ${p}_w$ and velocity fluctuation time series in the log region are considered, across friction-Reynolds-number ($Re_{\tau}$) range of $\mathcal{O}$($10^3$) $\lesssim$ $Re_{\tau}$ $\lesssim$ $\mathcal{O}$($10^6$). A recently proposed energy-decomposition methodology (Deshpande et al., J. Fluid Mech., vol. 914, 2021) is implemented to reveal the active and inactive contributions to the ${\tau}_w$- and $p_w$-spectra. Empirical evidence is provided in support of Bradshaw's (J. Fluid Mech., vol. 30, 1967) hypothesis that the inactive motions are responsible for the non-local wall-ward transport of the large-scale inertia-dominated energy, which is produced in the log region by active motions. This explains the large-scale signatures in the ${\tau}_w$-spectrum that are noted, despite negligible large-scale turbulence production near the wall. For wall pressure, active and inactive motions contribute to the $p_w$-spectra at intermediate and large scales, respectively. Their contributions are found to increase with increasing $Re_{\tau}$ due to the broadening and energization of the wall-scaled (attached) eddy hierarchy.


title: RankAdaptor: Hierarchical Dynamic Low-Rank Adaptation for Structural Pruned LLMs

abstract: The efficient compression of large language models (LLMs) is becoming increasingly popular. However, recovering the accuracy of compressed LLMs is still a major challenge. Structural pruning with standard Low-Rank Adaptation (LoRA) is a common technique in current LLM compression. In structural pruning, the model architecture is modified unevenly, resulting in suboptimal performance in various downstream tasks via standard LoRA with fixed rank. To address this problem, we introduce RankAdaptor, an efficient fine-tuning method with hierarchical dynamic rank scheduling for pruned LLMs. An end-to-end automatic optimization flow is developed that utilizes a lightweight performance model to determine the different ranks during fine-tuning. Comprehensive experiments on popular benchmarks show that RankAdaptor consistently outperforms standard LoRA with structural pruning over different pruning settings. Without increasing the trainable parameters, RankAdaptor further reduces the accuracy performance gap between the recovery of the pruned model and the original model compared to standard LoRA.


title: Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model

abstract: Diffusion models have obtained substantial progress in image-to-video (I2V) generation. However, such models are not fully understood. In this paper, we report a significant but previously overlooked issue in I2V diffusion models (I2V-DMs), namely, conditional image leakage. I2V-DMs tend to over-rely on the conditional image at large time steps, neglecting the crucial task of predicting the clean video from noisy inputs, which results in videos lacking dynamic and vivid motion. We further address this challenge from both inference and training aspects by presenting plug-and-play strategies accordingly. First, we introduce a training-free inference strategy that starts the generation process from an earlier time step to avoid the unreliable late-time steps of I2V-DMs, as well as an initial noise distribution with optimal analytic expressions (Analytic-Init) by minimizing the KL divergence between it and the actual marginal distribution to effectively bridge the training-inference gap. Second, to mitigate conditional image leakage during training, we design a time-dependent noise distribution for the conditional image, which favors high noise levels at large time steps to sufficiently interfere with the conditional image. We validate these strategies on various I2V-DMs using our collected open-domain image benchmark and the UCF101 dataset. Extensive results demonstrate that our methods outperform baselines by producing videos with more dynamic and natural motion without compromising image alignment and temporal consistency. The project page: \url{https://cond-image-leak.github.io/}.


title: Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

abstract: Recent years have seen a significant progress in the general-purpose problem solving abilities of large vision and language models (LVLMs), such as ChatGPT, Gemini, etc.; some of these breakthroughs even seem to enable AI models to outperform human abilities in varied tasks that demand higher-order cognitive skills. Are the current large AI models indeed capable of generalized problem solving as humans do? A systematic analysis of AI capabilities for joint vision and text reasoning, however, is missing in the current scientific literature. In this paper, we make an effort towards filling this gap, by evaluating state-of-the-art LVLMs on their mathematical and algorithmic reasoning abilities using visuo-linguistic problems from children's Olympiads. Specifically, we consider problems from the Mathematical Kangaroo (MK) Olympiad, which is a popular international competition targeted at children from grades 1-12, that tests children's deeper mathematical abilities using puzzles that are appropriately gauged to their age and skills. Using the puzzles from MK, we created a dataset, dubbed SMART-840, consisting of 840 problems from years 2020-2024. With our dataset, we analyze LVLMs power on mathematical reasoning; their responses on our puzzles offer a direct way to compare against that of children. Our results show that modern LVLMs do demonstrate increasingly powerful reasoning skills in solving problems for higher grades, but lack the foundations to correctly answer problems designed for younger children. Further analysis shows that there is no significant correlation between the reasoning capabilities of AI models and that of young children, and their capabilities appear to be based on a different type of reasoning than the cumulative knowledge that underlies children's mathematics and logic skills.


title: Correlation Functions From Tensor Network Influence Functionals: The Case of the Spin-Boson Model

abstract: We investigate the application of matrix product state (MPS) representations of the influence functionals (IF) for the calculation of real-time equilibrium correlation functions in open quantum systems. Focusing specifically on the unbiased spin-boson model, we explore the use of IF-MPSs for complex time propagation, as well as IF-MPSs for constructing correlation functions in the steady state. We examine three different IF approaches: one based on the Kadanoff-Baym contour targeting correlation functions at all times, one based on a complex contour targeting the correlation function at a single time, and a steady state formulation which avoids imaginary or complex times, while providing access to correlation functions at all times. We show that within the IF language, the steady state formulation provides a powerful approach to evaluate equilibrium correlation functions.


title: Observation of Heat Pumping Effect by Radiative Shuttling

abstract: Heat shuttling phenomenon is characterized by the presence of a non-zero heat flow between two bodies without net thermal bias on average. It was initially predicted in the context of nonlinear heat conduction within atomic lattices coupled to two time-oscillating thermostats. Recent theoretical works revealed an analog of this effect for heat exchanges mediated by thermal photons between two solids having a temperature dependent emissivity. In this paper, we present the experimental proof of this effect using systems made with composite materials based on phase change materials. By periodically modulating the temperature of one of two solids we report that the system akin to heat pumping with a controllable heat flow direction. Additionally, we demonstrate the effectiveness of a simultaneous modulation of two temperatures to control both the strength and direction of heat shuttling by exploiting the phase delay between these temperatures. These results show that this effect is promising for an active thermal management of solid-state technology, to cool down solids, to insulate them from their background or to amplify heat exchanges.


title: Robustness of Erd\H{o}s--Ko--Rado theorems on permutations and perfect matchings

abstract: The Erd\H{o}s--Ko--Rado (EKR) theorem and its generalizations can be viewed as classifications of maximum independent sets in appropriately defined families of graphs, such as the Kneser graph $K(n,k)$. In this paper, we investigate the independence number of random spanning subraphs of two other families of graphs whose maximum independent sets satisfy an EKR-type characterization: the derangement graph on the set of permutations in $\mathrm{Sym}(n)$ and the derangement graph on the set $\mathcal{M}_{n}$ of perfect matchings in the complete graph $\mathcal{K}_{2n}$. In both cases, we show there is a sharp threshold probability for the event that the independence number of a random spanning subgraph is equal to that of the original graph. As a useful tool to aid our computations, we obtain a Friedgut--Kalai--Naor (FKN) type theorem on sparse boolean functions whose domain is the vertex set of $\mathcal{M}_{n}$. In particular, we show that boolean functions whose Fourier transforms are highly concentrated on the first two irreducible modules in the $\mathrm{Sym}(2n)$ module $\mathbb{C}[\mathcal{M}_{n}]$, is close to being the characteristic function of a union of maximum independent sets in the derangement graph on perfect matchings.


title: The FRB-searching pipeline of the Tianlai Cylinder Pathfinder Array

abstract: This paper presents the design, calibration, and survey strategy of the Fast Radio Burst (FRB) digital backend and its real-time data processing pipeline employed in the Tianlai Cylinder Pathfinder array. The array, consisting of three parallel cylindrical reflectors and equipped with 96 dual-polarization feeds, is a radio interferometer array designed for conducting drift scans of the northern celestial semi-sphere. The FRB digital backend enables the formation of 96 digital beams, effectively covering an area of approximately 40 square degrees with 3 dB beam. Our pipeline demonstrates the capability to make automatic search of FRBs, detecting at quasi-real-time and classify FRB candidates automatically. The current FRB searching pipeline has an overall recall rate of 88\%. During the commissioning phase, we successfully detected signals emitted by four well-known pulsars: PSR B0329+54, B2021+51, B0823+26, and B2020+28. We report the first discovery of an FRB by our array, designated as FRB 20220414A. We also investigate the optimal arrangement for the digitally formed beams to achieve maximum detection rate by numerical simulation.


title: Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level

abstract: General-purpose Large Language Models (LLMs) like GPT-4 have achieved remarkable advancements in machine translation (MT) by leveraging extensive web content. On the other hand, translation-specific LLMs are built by pre-training on domain-specific monolingual corpora and fine-tuning with human-annotated translation data. Despite the superior performance, these methods either demand an unprecedented scale of computing and data or substantial human editing and annotation efforts. In this paper, we develop Ladder, a novel model-agnostic and cost-effective tool to refine the performance of general LLMs for MT. Ladder is trained on pseudo-refinement triplets which can be easily obtained from existing LLMs without additional human cost. During training, we propose a hierarchical fine-tuning strategy with an easy-to-hard schema, improving Ladder's refining performance progressively. The trained Ladder can be seamlessly integrated with any general-purpose LLMs to boost their translation performance. By utilizing Gemma-2B/7B as the backbone, Ladder-2B can elevate raw translations to the level of top-tier open-source models (e.g., refining BigTranslate-13B with +6.91 BLEU and +3.52 COMET for XX-En), and Ladder-7B can further enhance model performance to be on par with the state-of-the-art GPT-4. Extensive ablation and analysis corroborate the effectiveness of Ladder in diverse settings. Our code is available at https://github.com/fzp0424/Ladder


title: Probabilistic Programming with Programmable Variational Inference

abstract: Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection of variational objectives and gradient estimators, which are implemented monolithically (and without formal correctness arguments) in PPL backends. In this paper, we propose a more modular approach to supporting variational inference in PPLs, based on compositional program transformation. In our approach, variational objectives are expressed as programs, that may employ first-class constructs for computing densities of and expected values under user-defined models and variational families. We then transform these programs systematically into unbiased gradient estimators for optimizing the objectives they define. Our design enables modular reasoning about many interacting concerns, including automatic differentiation, density accumulation, tracing, and the application of unbiased gradient estimation strategies. Additionally, relative to existing support for VI in PPLs, our design increases expressiveness along three axes: (1) it supports an open-ended set of user-defined variational objectives, rather than a fixed menu of options; (2) it supports a combinatorial space of gradient estimation strategies, many not automated by today's PPLs; and (3) it supports a broader class of models and variational families, because it supports constructs for approximate marginalization and normalization (previously introduced only for Monte Carlo inference). We implement our approach in an extension to the Gen probabilistic programming system (genjax.vi, implemented in JAX), and evaluate on several deep generative modeling tasks, showing minimal performance overhead vs. hand-coded implementations and performance competitive with well-established open-source PPLs.


title: CasModaTest: A Cascaded and Model-agnostic Self-directed Framework for Unit Test Generation

abstract: Though many machine learning (ML)-based unit testing generation approaches have been proposed and indeed achieved remarkable performance, they still have several limitations in effectiveness and practical usage. More precisely, existing ML-based approaches (1) generate partial content of a unit test, mainly focusing on test oracle generation; (2) mismatch the test prefix with the test oracle semantically; and (3) are highly bound with the close-sourced model, eventually damaging data security. We propose CasModaTest, a cascaded, model-agnostic, and end-to-end unit test generation framework, to alleviate the above limitations with two cascaded stages: test prefix generation and test oracle generation. Then, we manually build large-scale demo pools to provide CasModaTest with high-quality test prefixes and test oracles examples. Finally, CasModaTest automatically assembles the generated test prefixes and test oracles and compiles or executes them to check their effectiveness, optionally appending with several attempts to fix the errors occurring in compiling and executing phases. To evaluate the effectiveness of CasModaTest, we conduct large-scale experiments on a widely used dataset (Defects4J) and compare it with four state-of-the-art (SOTA) approaches by considering two performance measures. The experimental results indicate that CasModaTest outperforms all SOTAs with a substantial improvement (i.e., 60.62%-352.55% in terms of accuracy, 2.83%-87.27% in terms of focal method coverage). Besides, we also conduct experiments of CasModaTest on different open-source LLMs and find that CasModaTest can also achieve significant improvements over SOTAs (39.82%-293.96% and 9.25%-98.95% in terms of accuracy and focal method coverage, respectively) in end-to-end unit test generation


title: Hecke operators on rational functions II

abstract: We study the action of the Hecke operators $U_n$ on the space $\mathcal R$ of rational functions of one variable, over $\mathbb C$. The main goal is to give a complete classification of the eigenfunctions of $U_n$, answering many questions that were raised in \cite{GilRobins}. We accomplish this by introducing certain number-theoretic directed graphs, called Zolotarev Graphs, which extend the well-known permutations due to Zolotarev. We develop the theory of the Zolotarev graphs, and discover certain strong relations between these graphs and the kernel of $U_n$ acting on a subspace of $\mathcal R$. We decompose the eigenfunctions of $U_n$ into certain natural finite-dimensional vector spaces of rational functions, which we call the eigenspaces. In this context, we prove that the dimension of each eigenspace is equal to the number of nodes of its corresponding Zolotarev graph, belonging to a cycle. We prove that the number of leaves of this Zolotarev graph equals the dimension of the kernel of $U_n$. We then give a novel number-theoretic formula for the number of cycles of fixed length, in each Zolotarev graph. We also study the simultaneous eigenfunctions for all of the $U_n$, and give explicit bases for all of them. Finally, we prove that the classical Artin Conjecture on primitive roots is equivalent to the conjecture that infinitely many of these eigenspaces have dimension $1$.


title: m-weak group inverse in a ring with proper involution

abstract: The m-weak group inverse was recently studied in the literature. The purpose of this paper is to investigate new properties of this generalized inverse for ring elements. We introduce the m-weak group decomposition for a ring element and prove that it coincides with its m-weak group invertibility. We present the equivalent characterization of the m-weak group inverse by using a polar-like property. The relations between m-weak group inverse and core-EP inverse are also established. These give some new properties of the weak group inverse for complex matrices and ring elements.


title: Graph polynomials: some questions on the edge

abstract: We raise some questions about graph polynomials, highlighting concepts and phenomena that may merit consideration in the development of a general theory. Our questions are mainly of three types: When do graph polynomials have reduction relations (simple linear recursions based on local operations), perhaps in a wider class of combinatorial objects? How many levels of reduction relations does a graph polynomial need in order to express it in terms of trivial base cases? For a graph polynomial, how are properties such as equivalence and factorisation reflected in the structure of a graph? We illustrate our discussion with a variety of graph polynomials and other invariants. This leads us to reflect on the historical origins of graph polynomials. We also introduce some new polynomials based on partial colourings of graphs and establish some of their basic properties.


title: Modeling Unknown Stochastic Dynamical System Subject to External Excitation

abstract: We present a numerical method for learning unknown nonautonomous stochastic dynamical system, i.e., stochastic system subject to time dependent excitation or control signals. Our basic assumption is that the governing equations for the stochastic system are unavailable. However, short bursts of input/output (I/O) data consisting of certain known excitation signals and their corresponding system responses are available. When a sufficient amount of such I/O data are available, our method is capable of learning the unknown dynamics and producing an accurate predictive model for the stochastic responses of the system subject to arbitrary excitation signals not in the training data. Our method has two key components: (1) a local approximation of the training I/O data to transfer the learning into a parameterized form; and (2) a generative model to approximate the underlying unknown stochastic flow map in distribution. After presenting the method in detail, we present a comprehensive set of numerical examples to demonstrate the performance of the proposed method, especially for long-term system predictions.


title: A class of overdetermined problem for fractional Capacity

abstract: In this paper, we consider an unconventional overdetermined problem through a property of concavity, which provides some characterizations of balls via Brunn-Minkowski inequalities. In this setting, our rsults can be viewed as the generalization of $p$-capacity in [14], which have its own interest.


title: Decay of CP-even Higgs $H\rightarrow h \gamma \gamma$ in Two Higgs Doublet Model: (I) one-loop analytic results, ward identity checks

abstract: We present the first analytical expressions for one-loop induced contributions for the decay channels of CP-even Higgs $H\rightarrow h \gamma \gamma$ with $h$ being standard model-like Higgs boson within the framework of Two Higgs Doublet Model in this paper. One-loop form factors for the decay processes are written in terms of the scalar Passarino-Veltman functions following the general notations of the package~{\tt LoopTools} as well as the library {\tt Collier}. Subsequently, physical results for the decay processes can be generated numerically by using one of the above-mentioned packages. The analytical expressions shown in this paper, are verified by several numerical checks, for examples, the ultraviolet (UV) and the infrared (IR) finiteness for one-loop amplitude. Furthermore, the amplitude must be followed the so-called ward identity due to on-shell photons in final states. The identity can also be tested numerically in this work. We find that the numerical results for the checks are good stability. In phenomenological studies, the differential decay rates as functions of the invariant of two photons in final state of $H\rightarrow h \gamma \gamma$ are first studied in parameter space for all types of Two Higgs Doublet Models.


title: Plasma Constraints on the Millicharged Dark Matter

abstract: Dark matter particles were suggested to have an electric charge smaller than the elementary charge unit $e$. The behavior of such a medium is similar to a collisionless plasma. In this paper, we set new stringent constraints on the charge and mass of the millicharged dark matter particle based on observational data on the Bullet X-ray Cluster.


title: Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Data

abstract: Recent years have seen increasing interest in applying deep learning methods to the modeling of guitar amplifiers or effect pedals. Existing methods are mainly based on the supervised approach, requiring temporally-aligned data pairs of unprocessed and rendered audio. However, this approach does not scale well, due to the complicated process involved in creating the data pairs. A very recent work done by Wright et al. has explored the potential of leveraging unpaired data for training, using a generative adversarial network (GAN)-based framework. This paper extends their work by using more advanced discriminators in the GAN, and using more unpaired data for training. Specifically, drawing inspiration from recent advancements in neural vocoders, we employ in our GAN-based model for guitar amplifier modeling two sets of discriminators, one based on multi-scale discriminator (MSD) and the other multi-period discriminator (MPD). Moreover, we experiment with adding unprocessed audio signals that do not have the corresponding rendered audio of a target tone to the training data, to see how much the GAN model benefits from the unpaired data. Our experiments show that the proposed two extensions contribute to the modeling of both low-gain and high-gain guitar amplifiers.


title: TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

abstract: Neural codec language model (LM) has demonstrated strong capability in zero-shot text-to-speech (TTS) synthesis. However, the codec LM often suffers from limitations in inference speed and stability, due to its auto-regressive nature and implicit alignment between text and audio. In this work, to handle these challenges, we introduce a new variant of neural codec LM, namely TacoLM. Specifically, TacoLM introduces a gated attention mechanism to improve the training and inference efficiency and reduce the model size. Meanwhile, an additional gated cross-attention layer is included for each decoder layer, which improves the efficiency and content accuracy of the synthesized speech. In the evaluation of the Librispeech corpus, the proposed TacoLM achieves a better word error rate, speaker similarity, and mean opinion score, with 90% fewer parameters and 5.2 times speed up, compared with VALL-E. Demo and code is available at https://ereboas.github.io/TacoLM/.


title: The Perils of Optimizing Learned Reward Functions: Low Training Error Does Not Guarantee Low Regret

abstract: In reinforcement learning, specifying reward functions that capture the intended task can be very challenging. Reward learning aims to address this issue by learning the reward function. However, a learned reward model may have a low error on the training distribution, and yet subsequently produce a policy with large regret. We say that such a reward model has an error-regret mismatch. The main source of an error-regret mismatch is the distributional shift that commonly occurs during policy optimization. In this paper, we mathematically show that a sufficiently low expected test error of the reward model guarantees low worst-case regret, but that for any fixed expected test error, there exist realistic data distributions that allow for error-regret mismatch to occur. We then show that similar problems persist even when using policy regularization techniques, commonly employed in methods such as RLHF. Our theoretical results highlight the importance of developing new ways to measure the quality of learned reward models.


title: Multimodal Segmentation for Vocal Tract Modeling

abstract: Accurate modeling of the vocal tract is necessary to construct articulatory representations for interpretable speech processing and linguistics. However, vocal tract modeling is challenging because many internal articulators are occluded from external motion capture technologies. Real-time magnetic resonance imaging (RT-MRI) allows measuring precise movements of internal articulators during speech, but annotated datasets of MRI are limited in size due to time-consuming and computationally expensive labeling methods. We first present a deep labeling strategy for the RT-MRI video using a vision-only segmentation approach. We then introduce a multimodal algorithm using audio to improve segmentation of vocal articulators. Together, we set a new benchmark for vocal tract modeling in MRI video segmentation and use this to release labels for a 75-speaker RT-MRI dataset, increasing the amount of labeled public RT-MRI data of the vocal tract by over a factor of 9. The code and dataset labels can be found at \url{rishiraij.github.io/multimodal-mri-avatar/}.


title: Fine-grained Background Representation for Weakly Supervised Semantic Segmentation

abstract: Generating reliable pseudo masks from image-level labels is challenging in the weakly supervised semantic segmentation (WSSS) task due to the lack of spatial information. Prevalent class activation map (CAM)-based solutions are challenged to discriminate the foreground (FG) objects from the suspicious background (BG) pixels (a.k.a. co-occurring) and learn the integral object regions. This paper proposes a simple fine-grained background representation (FBR) method to discover and represent diverse BG semantics and address the co-occurring problems. We abandon using the class prototype or pixel-level features for BG representation. Instead, we develop a novel primitive, negative region of interest (NROI), to capture the fine-grained BG semantic information and conduct the pixel-to-NROI contrast to distinguish the confusing BG pixels. We also present an active sampling strategy to mine the FG negatives on-the-fly, enabling efficient pixel-to-pixel intra-foreground contrastive learning to activate the entire object region. Thanks to the simplicity of design and convenience in use, our proposed method can be seamlessly plugged into various models, yielding new state-of-the-art results under various WSSS settings across benchmarks. Leveraging solely image-level (I) labels as supervision, our method achieves 73.2 mIoU and 45.6 mIoU segmentation results on Pascal Voc and MS COCO test sets, respectively. Furthermore, by incorporating saliency maps as an additional supervision signal (I+S), we attain 74.9 mIoU on Pascal Voc test set. Concurrently, our FBR approach demonstrates meaningful performance gains in weakly-supervised instance segmentation (WSIS) tasks, showcasing its robustness and strong generalization capabilities across diverse domains.


title: Estimation of the Soil Water Characteristics from Dielectric Relaxation Spectra -- a Machine Learning Approach

abstract: The frequency dependence of dielectric material properties of water saturated and unsaturated porous materials such as soil is not only disturbing in applications with high frequency electromagnetic (HF-EM) techniques but also contains valuable information of the material due to strong contributions by interactions between the aqueous pore solution and mineral phases. Hence, broadband HF-EM sensor techniques enable the estimation of soil physico-chemical parameters such as water content, texture, mineralogy, cation exchange capacity and matric potential. In this context, a multivariate (MV) machine learning approach (principal component regression, partial least squares regression, artificial neural networks) was applied to estimate the Soil Water Characteristic Curve (SWCC) from experimentally determined dielectric relaxation spectra of a silty clay soil. The results of the MV-approach were compared with results obtained from empirical equations and theoretical models as well as a novel hydraulic/electromagnetic coupling approach. The applied MV-approach gives evidence, (i) of a physical relationship between soil dielectric relaxation behavior and soil water characteristics as an important hydraulic material property and (ii) the applicability of appropriate sensor techniques for the estimation of physico-chemical parameters of porous media from broadband measured dielectric spectra.


title: Perturbative stability and error correction thresholds of quantum codes

abstract: Topologically-ordered phases are stable to local perturbations, and topological quantum error-correcting codes enjoy thresholds to local errors. We connect the two notions of stability by constructing classical statistical mechanics models for decoding general CSS codes and classical linear codes. Our construction encodes correction success probabilities under uncorrelated bit-flip and phase-flip errors, and simultaneously describes a generalized Z2 lattice gauge theory with quenched disorder. We observe that the clean limit of the latter is precisely the discretized imaginary time path integral of the corresponding quantum code Hamiltonian when the errors are turned into a perturbative X or Z magnetic field. Motivated by error correction considerations, we define general order parameters for all such generalized Z2 lattice gauge theories, and show that they are generally lower bounded by success probabilities of error correction. For CSS codes satisfying the LDPC condition and with a sufficiently large code distance, we prove the existence of a low temperature ordered phase of the corresponding lattice gauge theories, particularly for those lacking Euclidean spatial locality and/or when there is a nonzero code rate. We further argue that these results provide evidence to stable phases in the corresponding perturbed quantum Hamiltonians, obtained in the limit of continuous imaginary time. To do so, we distinguish space- and time-like defects in the lattice gauge theory. A high free-energy cost of space-like defects corresponds to a successful "memory experiment" and suppresses the energy splitting among the ground states, while a high free-energy cost of time-like defects corresponds to a successful "stability experiment" and points to a nonzero gap to local excitations.


title: EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting

abstract: Efficient adaption of large language models (LLMs) on edge devices is essential for applications requiring continuous and privacy-preserving adaptation and inference. However, existing tuning techniques fall short because of the high computation and memory overheads. To this end, we introduce a computation- and memory-efficient LLM tuning framework, called Edge-LLM, to facilitate affordable and effective LLM adaptation on edge devices. Specifically, Edge-LLM features three core components: (1) a layer-wise unified compression (LUC) technique to reduce the computation overhead by generating layer-wise pruning sparsity and quantization bit-width policies, (2) an adaptive layer tuning and voting scheme to reduce the memory overhead by reducing the backpropagation depth, and (3) a complementary hardware scheduling strategy to handle the irregular computation patterns introduced by LUC and adaptive layer tuning, thereby achieving efficient computation and data movements. Extensive experiments demonstrate that Edge-LLM achieves a 2.92x speed up and a 4x memory overhead reduction as compared to vanilla tuning methods with comparable task accuracy. Our code is available at https://github.com/GATECH-EIC/Edge-LLM