title: On the Migration Origin of the Hercules Moving Group with GAIA, LAMOST, APOGEE, and GALAH Surveys

abstract: Using Gaia DR3 data and the wavelet transformation technique, we study the substructures of the Hercules moving group (HMG): Hercules 1 (H1) and Hercules 2 (H2). Spectroscopic survey data from LAMOST, APOGEE, and GALAH are used to obtain metallicities and ages of stars belonging to the HMG. Our analysis leads to several key findings as follows: ($a$) the HMG is on average richer in metallicity than the Galactic disk, with H2 being metal richer than H1; ($b$) the HMG likely has a radial metallicity gradient distinct from that of the disk; ($c$) the HMG is on average older than the disk, with H2 being older than H1; ($d$) the HMG likely has a radial age gradient distinct from that of the disk; and ($e$) the metallicity and age distributions of the HMG depend mainly on the Galactic radius but show no dependence on the azimuthal velocity. Taken all together, we conclude that the HMG is composed primarily of stars undergoing radial migration. We suggest that the HMG is associated with a higher-order dynamical resonance of the bar of the Galaxy.


title: The Impact of Exposed Passwords on Honeyword Efficacy

abstract: Honeywords are decoy passwords that can be added to a credential database; if a login attempt uses a honeyword, this indicates that the site's credential database has been leaked. In this paper we explore the basic requirements for honeywords to be effective, in a threat model where the attacker knows passwords for the same users at other sites. First, we show that for user-chosen (vs. algorithmically generated, i.e., by a password manager) passwords, existing honeyword-generation algorithms do not simultaneously achieve false-positive and false-negative rates near their ideals of $\approx 0$ and $\approx \frac{1}{1+n}$, respectively, in this threat model, where $n$ is the number of honeywords per account. Second, we show that for users leveraging algorithmically generated passwords, state-of-the-art methods for honeyword generation will produce honeywords that are not sufficiently deceptive, yielding many false negatives. Instead, we find that only a honeyword-generation algorithm that uses the \textit{same} password generator as the user can provide deceptive honeywords in this case. However, when the defender's ability to infer the generator from the (one) account password is less accurate than the attacker's ability to infer the generator from potentially many, this deception can again wane. Taken together, our results provide a cautionary note for the state of honeyword research and pose new challenges to the field.


title: Metastatic Breast Cancer Prognostication Through Multimodal Integration of Dimensionality Reduction Algorithms and Classification Algorithms

abstract: Machine learning (ML) is a branch of Artificial Intelligence (AI) where computers analyze data and find patterns in the data. The study focuses on the detection of metastatic cancer using ML. Metastatic cancer is the point where the cancer has spread to other parts of the body and is the cause of approximately 90% of cancer related deaths. Normally, pathologists spend hours each day to manually classify whether tumors are benign or malignant. This tedious task contributes to mislabeling metastasis being over 60% of time and emphasizes the importance to be aware of human error, and other inefficiencies. ML is a good candidate to improve the correct identification of metastatic cancer saving thousands of lives and can also improve the speed and efficiency of the process thereby taking less resources and time. So far, deep learning methodology of AI has been used in the research to detect cancer. This study is a novel approach to determine the potential of using preprocessing algorithms combined with classification algorithms in detecting metastatic cancer. The study used two preprocessing algorithms: principal component analysis (PCA) and the genetic algorithm to reduce the dimensionality of the dataset, and then used three classification algorithms: logistic regression, decision tree classifier, and k-nearest neighbors to detect metastatic cancer in the pathology scans. The highest accuracy of 71.14% was produced by the ML pipeline comprising of PCA, the genetic algorithm, and the k-nearest neighbors algorithm, suggesting that preprocessing and classification algorithms have great potential for detecting metastatic cancer.


title: Predicting fine-scale taxonomic variation in landscape vegetation using large satellite imagery data sets

abstract: Accurate information on the distribution of vegetation species is used as a proxy for the health of an ecosystem, a currency of international environmental treaties, and a necessary planning tool for forest preservation and rehabilitation, to name just a few of its applications. However, direct, extensive observation of vegetation across large geographic regions can be very expensive. The extensive coverage and high temporal resolution of remote sensing data collected by satellites like the European Space Agency's Sentinel-2 system could be a critical component of a solution to this problem. We propose a hierarchical model for predicting vegetation cover that incorporates high resolution satellite imagery, landscape characteristics such as elevation and slope, and direct observation of vegetation cover. Besides providing model-based predictions of vegetation cover with accompanying uncertainty quantification, our proposed model offers inference about the effects of landscape characteristics on vegetation type. Implementation of the model is computationally challenging due to the volume and spatial extent of data involved. Thus, we propose an efficient, approximate method for model fitting that is able to make use of all available observations. We demonstrate our approach with an application to the distribution of three post-fire resprouting deciduous species in the Jemez Mountains of New Mexico.


title: QASnowball: An Iterative Bootstrapping Framework for High-Quality Question-Answering Data Generation

abstract: Recent years have witnessed the success of question answering (QA), especially its potential to be a foundation paradigm for tackling diverse NLP tasks. However, obtaining sufficient data to build an effective and stable QA system still remains an open problem. For this problem, we introduce an iterative bootstrapping framework for QA data augmentation (named QASnowball), which can iteratively generate large-scale high-quality QA data based on a seed set of supervised examples. Specifically, QASnowball consists of three modules, an answer extractor to extract core phrases in unlabeled documents as candidate answers, a question generator to generate questions based on documents and candidate answers, and a QA data filter to filter out high-quality QA data. Moreover, QASnowball can be self-enhanced by reseeding the seed set to fine-tune itself in different iterations, leading to continual improvements in the generation quality. We conduct experiments in the high-resource English scenario and the medium-resource Chinese scenario, and the experimental results show that the data generated by QASnowball can facilitate QA models: (1) training models on the generated data achieves comparable results to using supervised data, and (2) pre-training on the generated data and fine-tuning on supervised data can achieve better performance. Our code and generated data will be released to advance further work.


title: Layer-dependent exciton polarizability and the brightening of dark excitons in few-layer black phosphorus

abstract: The evolution of excitons from 2D to 3D is of great importance in photo-physics, yet the layer-dependent exciton polarizability has not been investigated in 2D semiconductors. Here, we determine the exciton polarizabilities for 3- to 11-layer black phosphorus-a direct bandgap semiconductor regardless of the thickness-through frequency-resolved photocurrent measurements on dual-gate devices and unveil the carrier screening effect in relatively thicker samples. By taking advantage of the broadband photocurrent spectra, we are also able to reveal the exciton response for higher-index subbands under the gate electrical field. Surprisingly, dark excitons are brightened with intensity even stronger than the allowed transitions above certain electrical field. Our study not only sheds light on the exciton evolution with sample thickness, but also paves a way for optoelectronic applications of few-layer BP in modulators, tunable photodetectors, emitters and lasers.


title: Computational Approaches for App-to-App Retrieval and Design Consistency Check

abstract: Extracting semantic representations from mobile user interfaces (UI) and using the representations for designers' decision-making processes have shown the potential to be effective computational design support tools. Current approaches rely on machine learning models trained on small-sized mobile UI datasets to extract semantic vectors and use screenshot-to-screenshot comparison to retrieve similar-looking UIs given query screenshots. However, the usability of these methods is limited because they are often not open-sourced and have complex training pipelines for practitioners to follow, and are unable to perform screenshot set-to-set (i.e., app-to-app) retrieval. To this end, we (1) employ visual models trained with large web-scale images and test whether they could extract a UI representation in a zero-shot way and outperform existing specialized models, and (2) use mathematically founded methods to enable app-to-app retrieval and design consistency analysis. Our experiments show that our methods not only improve upon previous retrieval models but also enable multiple new applications.


title: Learning based 2D Irregular Shape Packing

abstract: 2D irregular shape packing is a necessary step to arrange UV patches of a 3D model within a texture atlas for memory-efficient appearance rendering in computer graphics. Being a joint, combinatorial decision-making problem involving all patch positions and orientations, this problem has well-known NP-hard complexity. Prior solutions either assume a heuristic packing order or modify the upstream mesh cut and UV mapping to simplify the problem, which either limits the packing ratio or incurs robustness or generality issues. Instead, we introduce a learning-assisted 2D irregular shape packing method that achieves a high packing quality with minimal requirements from the input. Our method iteratively selects and groups subsets of UV patches into near-rectangular super patches, essentially reducing the problem to bin-packing, based on which a joint optimization is employed to further improve the packing ratio. In order to efficiently deal with large problem instances with hundreds of patches, we train deep neural policies to predict nearly rectangular patch subsets and determine their relative poses, leading to linear time scaling with the number of patches. We demonstrate the effectiveness of our method on three datasets for UV packing, where our method achieves a higher packing ratio over several widely used baselines with competitive computational speed.


title: Time Stretch with Continuous-Wave Lasers

abstract: A single-shot measurement technique for ultrafast phenomena with high throughput enables the capture of rare events within a short time scale, facilitating the exploration of rare ultrafast processes. Photonic time stretch stands out as a highly effective method for both detecting rapid events and achieving remarkable speed in imaging and ranging applications. The current time stretch method relies on costly passive mode-locked lasers with continuous and fixed spectra to capture fast transients and dilate their time scale using dispersion. This hinders the broad application of time stretch technology and presents synchronization challenges with ultrafast events for measurement. Here we report the first implementation of time stretch using continuous wave (CW) diode lasers with discrete and tunable spectra that are common in WDM optical communication. This approach offers the potential for more cost-effective and compact time stretch systems and simplifies laser synchronization with the input signal. Two different embodiments in the United States and Japan demonstrate the technique's operation and limitations, and potential applications to time stretch imaging and angular light scattering.


title: Hardness results for decoding the surface code with Pauli noise

abstract: Real quantum computers will be subject to complicated, qubit-dependent noise, instead of simple noise such as depolarizing noise with the same strength for all qubits. We can do quantum error correction more effectively if our decoding algorithms take into account this prior information about the specific noise present. This motivates us to consider the complexity of surface code decoding where the input to the decoding problem is not only the syndrome-measurement results, but also a noise model in the form of probabilities of single-qubit Pauli errors for every qubit. In this setting, we show that quantum maximum likelihood decoding (QMLD) and degenerate quantum maximum likelihood decoding (DQMLD) for the surface code are NP-hard and #P-hard, respectively. We reduce directly from SAT for QMLD, and from #SAT for DQMLD, by showing how to transform a boolean formula into a qubit-dependent Pauli noise model and set of syndromes that encode the satisfiability properties of the formula. We also give hardness of approximation results for QMLD and DQMLD. These are worst-case hardness results that do not contradict the empirical fact that many efficient surface code decoders are correct in the average case (i.e., for most sets of syndromes and for most reasonable noise models). These hardness results are nicely analogous with the known hardness results for QMLD and DQMLD for arbitrary stabilizer codes with independent $X$ and $Z$ noise.


title: Towards a Realistic Model for Cavity-Enhanced Atomic Frequency Comb Quantum Memories

abstract: Atomic frequency comb (AFC) quantum memory is a favorable protocol in long distance quantum communication. Putting the AFC inside an asymmetric optical cavity enhances the storage efficiency but makes the measurement of the comb properties challenging. We develop a theoretical model for cavity-enhanced AFC quantum memory that includes the effects of dispersion, and show a close alignment of the model with our own experimental results. Providing semi quantitative agreement for estimating the efficiency and a good description of how the efficiency changes as a function of detuning, it also captures certain qualitative features of the experimental reflectivity. For comparison, we show that a theoretical model without dispersion fails dramatically to predict the correct efficiencies. Our model is a step forward to accurately estimating the created comb properties, such as the optical depth inside the cavity, and so being able to make precise predictions of the performance of the prepared cavity-enhanced AFC quantum memory.


title: QubiC 2.0: An Extensible Open-Source Qubit Control System Capable of Mid-Circuit Measurement and Feed-Forward

abstract: Researchers manipulate and measure quantum processing units via the classical electronics control system. We developed an open-source FPGA-based quantum bit control system called QubiC for superconducting qubits. After a few years of qubit calibration and testing experience on QubiC 1.0, we recognized the need for mid-circuit measurements and feed-forward capabilities to implement advanced quantum algorithms effectively. Moreover, following the development of RFSoC technology, we upgraded the system to QubiC 2.0 on an Xilinx ZCU216 evaluation board and developed all these enriched features. The system uses portable FPGA gateware with a simplified processor to handle commands on-the-fly. For design simplicity and straightforward scaling, we adopted a multi-core distributed architecture, assigning one processor core per qubit. The actual pulses combine the unique pulse envelope and carrier information specified in a command. Each pulse envelope is pre-stored on FPGA's block RAMs, ensuring the speed and reusability during the whole circuit. The pulse parameters including amplitude, phase, and frequency can be updated from pulse to pulse. The software stack is developed in Python, running on both the FPGA's ARM core and host computer via XML-RPC. The quantum circuit can be described in a high-level language, which supports programming at both pulse-level and native-gate level, and includes high-level control flow constructs. The QubiC software stack compiles these quantum programs into binary commands that can be loaded into the FPGA. With Qubic 2.0, we successfully achieved multi-FPGA synchronization in bench tests and demonstrated simplified feed-forward experiments on conditional circuits. The enhanced QubiC system represents a significant step forward in quantum computing, providing researchers with powerful tools to explore and implement advanced quantum algorithms and applications.


title: Information geometric bound on general chemical reaction networks

abstract: We investigate the dynamics of chemical reaction networks (CRNs) with the goal of deriving an upper bound on their reaction rates. This task is challenging due to the nonlinear nature and discrete structure inherent in CRNs. To address this, we employ an information geometric approach, using the natural gradient, to develop a nonlinear system that yields an upper bound for CRN dynamics. We validate our approach through numerical simulations, demonstrating faster convergence in a specific class of CRNs. This class is characterized by the number of chemicals, the maximum value of stoichiometric coefficients of the chemical reactions, and the number of reactions. We also compare our method to a conventional approach, showing that the latter cannot provide an upper bound on reaction rates of CRNs. While our study focuses on CRNs, the ubiquity of hypergraphs in fields from natural sciences to engineering suggests that our method may find broader applications, including in information science.

categories: physics.chem-ph cond-mat.stat-mech cs.IT math.IT stat.ML


title: Magnetic phase transitions in the triangular-lattice spin-1 dimer compound K2Ni2(SeO3)3

abstract: In our study, we conduct magnetization and heat capacity measurements to investigate field induced magnetic phase transitions within the newly synthesized compound K2Ni2(SeO3)3, a spin-1 dimer system arranged on a triangular lattice. From our first-principles simulations, we determine that the spin system in K2Ni2(SeO3)3 can be represented as a two-dimensional triangular-lattice spin-1 dimer model, including an intra-dimer exchange of J1 = 0.32 meV, an inter-dimer exchange of J2 = 0.79 meV, and an easy-axis anisotropy of D = 0.14 meV. The presence of easy-axis magnetic anisotropy explains the distinct magnetic phase diagrams observed under c-axis directional and in-plane magnetic fields. Notably, our investigation unveils a two-step phase transition with the magnetic field aligned with the c direction. Our findings yield valuable insights into the magnetic phase transitions inherent to geometrically frustrated magnetic systems featuring dimer structures.


title: Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detail

abstract: We present LoD-NeuS, an efficient neural representation for high-frequency geometry detail recovery and anti-aliased novel view rendering. Drawing inspiration from voxel-based representations with the level of detail (LoD), we introduce a multi-scale tri-plane-based scene representation that is capable of capturing the LoD of the signed distance function (SDF) and the space radiance. Our representation aggregates space features from a multi-convolved featurization within a conical frustum along a ray and optimizes the LoD feature volume through differentiable rendering. Additionally, we propose an error-guided sampling strategy to guide the growth of the SDF during the optimization. Both qualitative and quantitative evaluations demonstrate that our method achieves superior surface reconstruction and photorealistic view synthesis compared to state-of-the-art approaches.


title: FedWOA: A Federated Learning Model that uses the Whale Optimization Algorithm for Renewable Energy Prediction

abstract: Privacy is important when dealing with sensitive personal information in machine learning models, which require large data sets for training. In the energy field, access to household prosumer energy data is crucial for energy predictions to support energy grid management and large-scale adoption of renewables however citizens are often hesitant to grant access to cloud-based machine learning models. Federated learning has been proposed as a solution to privacy challenges however report issues in generating the global prediction model due to data heterogeneity, variations in generation patterns, and the high number of parameters leading to even lower prediction accuracy. This paper addresses these challenges by introducing FedWOA a novel federated learning model that employs the Whale Optimization Algorithm to aggregate global prediction models from the weights of local LTSM neural network models trained on prosumer energy data. The proposed solution identifies the optimal vector of weights in the search spaces of the local models to construct the global shared model and then is subsequently transmitted to the local nodes to improve the prediction quality at the prosumer site while for handling non-IID data K-Means was used for clustering prosumers with similar scale of energy data. The evaluation results on prosumers energy data have shown that FedWOA can effectively enhance the accuracy of energy prediction models accuracy by 25% for MSE and 16% for MAE compared to FedAVG while demonstrating good convergence and reduced loss.


title: Chiral Skyrmions Interacting with Chiral Flowers

abstract: The chiral nature of active matter plays an important role in the dynamics of active matter interacting with chiral structures. Skyrmions are chiral objects, and their interactions with chiral nanostructures can lead to intriguing phenomena. Here, we explore the random-walk dynamics of a thermally activated chiral skyrmion interacting with a chiral flower-like obstacle in a ferromagnetic layer, which could create topology-dependent outcomes. It is a spontaneous mesoscopic order-from-disorder phenomenon driven by the thermal fluctuations and topological nature of skyrmions that exists only in ferromagnetic and ferrimagnetic systems. The interactions between the skyrmions and chiral flowers at finite temperatures can be utilized to control the skyrmion position and distribution without applying any external driving force or temperature gradient. The phenomenon that thermally activated skyrmions are dynamically coupled to chiral flowers may provide a new way to design topological sorting devices.


title: KoBigBird-large: Transformation of Transformer for Korean Language Understanding

abstract: This work presents KoBigBird-large, a large size of Korean BigBird that achieves state-of-the-art performance and allows long sequence processing for Korean language understanding. Without further pretraining, we only transform the architecture and extend the positional encoding with our proposed Tapered Absolute Positional Encoding Representations (TAPER). In experiments, KoBigBird-large shows state-of-the-art overall performance on Korean language understanding benchmarks and the best performance on document classification and question answering tasks for longer sequences against the competitive baseline models. We publicly release our model here.


title: Striking a Balance: An Optimal Mechanism Design for Heterogenous Differentially Private Data Acquisition for Logistic Regression

abstract: We investigate the problem of performing logistic regression on data collected from privacy-sensitive sellers. Since the data is private, sellers must be incentivized through payments to provide their data. Thus, the goal is to design a mechanism that optimizes a weighted combination of test loss, seller privacy, and payment, i.e., strikes a balance between multiple objectives of interest. We solve the problem by combining ideas from game theory, statistical learning theory, and differential privacy. The buyer's objective function can be highly non-convex. However, we show that, under certain conditions on the problem parameters, the problem can be convexified by using a change of variables. We also provide asymptotic results characterizing the buyer's test error and payments when the number of sellers becomes large. Finally, we demonstrate our ideas by applying them to a real healthcare data set.


title: Theory of Nonequilibrium Symmetry-Breaking Coexistence and Active Crystallization

abstract: Crystallization is perhaps the most familiar example of a symmetry-breaking transition. In equilibrium, thermodynamic arguments result in a powerful and convenient set of criteria for determining the coexistence curves associated with these transitions. In recent years, nonequilibrium symmetry-breaking transitions have been routinely observed in a variety of natural and synthetic systems. The breaking of detailed balance, and the resulting absence of Boltzmann statistics, motivates the need for a symmetry-breaking coexistence theory that is independent of the underlying distribution of microstates. Here, we develop such a theory, relying only on mechanics, balance laws, and system symmetries. In doing so, we develop a generalized Gibbs-Duhem relation that results in nonequilibrium coexistence criteria solely in terms of bulk equations of state. We apply our framework to active crystallization, developing a complete description of the phase diagram of active Brownian hard spheres. Our predicted phase diagram quantitatively recapitulates the solid-fluid coexistence curve as well as other key features of active phase behavior, such as the liquid-gas coexistence binodal and solid-liquid-gas triple point. It is our hope that our findings offer a concrete path forward towards the development of a general theory for nonequilibrium coexistence.


title: Optimal Beamforming Structure for Rate Splitting Multiple Access

abstract: In this paper, we aim at maximizing the weighted sum-rate (WSR) of rate splitting multiple access (RSMA) in multi-user multi-antenna transmission networks through the joint optimization of rate allocation and beamforming. Unlike conventional methods like weighted minimum mean square error (WMMSE) and standard fractional programming (FP), which tackle the non-convex WSR problem iteratively using disciplined convex subproblems and optimization toolboxes, our work pioneers a novel toolbox-free approach. For the first time, we identify the optimal beamforming structure and common rate allocation for WSR maximization in RSMA by leveraging FP and Lagrangian duality. Then we propose an algorithm based on FP and fixed point iteration to optimize the beamforming and common rate allocation without the need for optimization toolboxes. Our numerical results demonstrate that the proposed algorithm attains the same performance as standard FP and classical WMMSE methods while significantly reducing computational time.


title: Endpoint theory for the compactness of commutators

abstract: In this paper, we establish a Minkowski-type inequality for weak Lebesgue space, which allows us to obtain a characterization of relative compactness in these spaces. Furthermore, we are the first to investigate the compactness results of commutators at the endpoint. The paper provides a comprehensive study of the compactness properties of commutators of Calder\'{o}n-Zygmund operators in Hardy and $L^{1}(\mathbb{R}^n)$ type spaces. Additionally, we provide factorization theorems for Hardy spaces in terms of singular integral operators in the $L^1(\mathbb{R}^n)$ space.


title: A First Look at SVCB and HTTPS DNS Resource Records in the Wild

abstract: The Internet Engineering Task Force is standardizing new DNS resource records, namely SVCB and HTTPS. Both records inform clients about endpoint and service properties such as supported application layer protocols, IP address hints or Encrypted Client Hello (ECH) information. Therefore, they allow clients to reduce required DNS queries and potential retries during connection establishment and thus help to improve the quality of experience and privacy of the client. The latter is achieved by reducing visible meta-data, which is further improved with encrypted DNS and ECH. The standardization is in its final stages and companies announced support, e.g., Cloudflare and Apple. Therefore, we provide the first large-scale overview of actual record deployment by analyzing more than 400 M domains. We find 3.96 k SVCB and 10.5 M HTTPS records. As of March 2023, Cloudflare hosts and serves most domains, and most records only contain Application-Layer Protocol Negotiation (ALPN) and IP address hints. Besides Cloudflare, we see adoption by a variety of authoritative name servers and hosting providers indicating increased adoption in the near future. Lastly, we can verify the correctness of records for more than 93 % of domains based on three application layer scans.


title: Stasis, Stasis, Triple Stasis

abstract: Many theories of BSM physics predict the existence of large or infinite towers of decaying states. In a previous paper (arXiv:2111.04753) we pointed out that this can give rise to a surprising cosmological phenomenon that we dubbed "stasis" during which the relative abundances of matter and radiation remain constant across extended cosmological eras even though the universe is expanding. Indeed, such stasis epochs are universal attractors, with the universe necessarily entering (and later exiting) such epochs for a wide variety of initial conditions. Matter/radiation stasis is therefore an important and potentially unavoidable feature of many BSM cosmologies. In this paper we extend our arguments to universes containing significant amounts of vacuum energy, and demonstrate that such universes also give rise to various forms of stasis between vacuum energy and either matter or radiation. We also demonstrate the existence of several forms of "triple stasis" during which the abundances of matter, radiation, and vacuum energy all simultaneously remain fixed despite cosmological expansion. We further describe several close variants of stasis which we call "quasi-stasis" and "oscillatory stasis" and discuss the circumstances under which each of these can arise. Finally, we develop a general formalism for understanding the emergence of stasis within BSM cosmologies irrespective of the number or type of different energy components involved. Taken together, these results greatly expand the range of theoretical and phenomenological possibilities for the physics of the early universe, introducing new types of cosmological eras which may play an intrinsic and potentially inevitable role within numerous BSM cosmologies.


title: Explaining Agent Behavior with Large Language Models

abstract: Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is often produced by uninterpretable models such as deep neural networks. We propose an approach to generate natural language explanations for an agent's behavior based only on observations of states and actions, agnostic to the underlying model representation. We show how a compact representation of the agent's behavior can be learned and used to produce plausible explanations with minimal hallucination while affording user interaction with a pre-trained large language model. Through user studies and empirical experiments, we show that our approach generates explanations as helpful as those generated by a human domain expert while enabling beneficial interactions such as clarification and counterfactual queries.


title: Enhancing Congestion Control to Improve User Experience in IoT Using LSTM Network

abstract: This study suggests a new strategy for improving congestion control by deploying Long Short-Term Memory (LSTM) networks. LSTMs are recurrent neural networks (RNN), that excel at capturing temporal relationships and patterns in data. IoT-specific data such as network traffic patterns, device interactions, and congestion occurrences are gathered and analyzed. The gathered data is used to create and train an LSTM network architecture specific to the IoT environment. Then, the LSTM model's predictive skills are incorporated into the congestion control methods. This work intends to optimize congestion management methods using LSTM networks, which results in increased user satisfaction and dependable IoT connectivity. Utilizing metrics like throughput, latency, packet loss, and user satisfaction, the success of the suggested strategy is evaluated. Evaluation of performance includes rigorous testing and comparison to conventional congestion control methods.


abstract: Adversarial purification using generative models demonstrates strong adversarial defense performance. These methods are classifier and attack-agnostic, making them versatile but often computationally intensive. Recent strides in diffusion and score networks have improved image generation and, by extension, adversarial purification. Another highly efficient class of adversarial defense methods known as adversarial training requires specific knowledge of attack vectors, forcing them to be trained extensively on adversarial examples. To overcome these limitations, we introduce a new framework, namely Language Guided Adversarial Purification (LGAP), utilizing pre-trained diffusion models and caption generators to defend against adversarial attacks. Given an input image, our method first generates a caption, which is then used to guide the adversarial purification process through a diffusion network. Our approach has been evaluated against strong adversarial attacks, proving its effectiveness in enhancing adversarial robustness. Our results indicate that LGAP outperforms most existing adversarial defense techniques without requiring specialized network training. This underscores the generalizability of models trained on large datasets, highlighting a promising direction for further research.


title: Resolving moving heliospheric structures using interplanetary scintillation observations with the Murchison Widefield Array

abstract: We have conducted a blind search in 49 consecutive days of interplanetary scintillation observations made by the Murchison Widefield Array from mid-2019, with overlapping daily observations approximately East and South-East of the Sun at an elongation of $\sim$30 degrees and a field of view of 30 degrees. These observations detect an unprecedented density of sources. In spite of these observations being taken at sunspot minimum, this search has revealed several interesting transitory features characterised by elevated scintillation levels. One solar wind enhancement is captured in two observations several hours apart, allowing its radial movement away from the Sun to be measured. We present here a methodology for measuring the plane-of-sky velocity for the moving heliospheric structure. The plane-of-sky velocity was inferred as $0.66\pm0.147\,^{\text{o}}\text{hr}^{-1}$, or $480\pm106\,\text{km}\,\text{s}^{-1}$ assuming a distance of 1AU. After cross-referencing our observed structure with multiple catalogues of heliospheric events, we propose that the likely source of our observed structure is a stream-interaction region originating from a low-latitude coronal hole. This work demonstrates the power of widefield interplanetary scintillation observations to capture detailed features in the heliosphere which are otherwise unresolvable and go undetected.


title: Fast and reconfigurable sort-in-memory system enabled by memristors

abstract: Sorting is fundamental and ubiquitous in modern computing systems. Hardware sorting systems are built based on comparison operations with Von Neumann architecture, but their performance are limited by the bandwidth between memory and comparison units and the performance of complementary metal-oxide-semiconductor (CMOS) based circuitry. Sort-in-memory (SIM) based on emerging memristors is desired but not yet available due to comparison operations that are challenging to be implemented within memristive memory. Here we report fast and reconfigurable SIM system enabled by digit read (DR) on 1-transistor-1-resistor (1T1R) memristor arrays. We develop DR tree node skipping (TNS) that support variable data quantity and data types, and extend TNS with multi-bank, bit-slice and multi-level strategies to enable cross-array TNS (CA-TNS) for practical adoptions. Experimented on benchmark sorting datasets, our memristor-enabled SIM system presents up to 3.32x~7.70x speedup, 6.23x~183.5x energy efficiency improvement and 2.23x~7.43x area reduction compared with state-of-the-art sorting systems. We apply such SIM system for shortest path search with Dijkstra's algorithm and neural network inference with in-situ pruning, demonstrating the capability in solving practical sorting tasks and the compatibility in integrating with other compute-in-memory (CIM) schemes. The comparison-free TNS/CA-TNS SIM enabled by memristors pushes sorting into a new paradigm of sort-in-memory for next-generation sorting systems.


title: Determination of the branching ratio of CH$_3$OH + OH reaction on water ice surface at 10 K

abstract: The CH$_3$O and CH$_2$OH radicals can be important precursors of complex organic molecules (COMs) in interstellar dust. The COMs presumably originating from these radicals were abundantly found in various astronomical objects. Because each radical leads to different types of COMs, determining the abundance ratio of CH$_3$O to CH$_2$OH is crucial for a better understanding of the chemical evolution to various COMs. Recent work suggested that the reaction between CH$_3$OH and OH on ice dust plays an important role in forming CH$_3$O and CH$_2$OH radicals. However, quantitative details on the abundance of these radicals have not been presented to date. Herein, we experimentally determined the branching ratio (CH$_3$O/CH$_2$OH) resulting from the CH$_3$OH + OH reaction on the water ice surface at 10 K to be 4.3 $\pm$ 0.6. Furthermore, the CH$_3$O product in the reaction would participate in subsequent diffusive reactions even at a temperature as low as 10 K. This fact should provide critical information for COMs formation models in cold molecular clouds.


title: $\Gamma$-convergence of Nonlocal Dirichlet Energies With Penalty Formulations of Dirichlet Boundary Data

abstract: We study nonlocal Dirichlet energies associated with a class of nonlocal diffusion models on a bounded domain subject to the conventional local Dirichlet boundary condition. The Dirichlet boundary condition is imposed through a specifically designed penalty formulation. We prove that the nonlocal Dirichlet energies with the penalty terms converge to local Dirichlet energies with Dirichlet boundary conditions in the sense of $\varGamma$-convergence.


title: A characterization of von Neumann entropy using functors

abstract: Baez, Fritz, and Leinster derived a method for characterizing Shannon entropy in classical systems. In this method, they considered a functor from a certain category to the monoid of non-negative real numbers with addition as a map from measure-preserving functions to non-negative real numbers, and derived Shannon entropy by imposing several simple conditions. We propose a method for characterizing von Neumann entropy by extending their results to quantum systems.


title: KMS states on the $\mathrm{C}^*$-algebras of Fell bundles over {\'e}tale groupoids

abstract: Let $p\colon \mathcal{A} \to G$ be a saturated Fell bundle over a locally compact, Hausdorff, second countable, {\'e}tale groupoid~$G$, and let $\mathrm{C}^*(G;\mathcal{A})$ denote its full $\mathrm{C}^*$-algebra. We prove an integration-disintegration theorem for KMS states on $\mathrm{C}^*(G;\mathcal{A})$ by establishing a one-to-one correspondence between such states and fields of measurable states on the $\mathrm{C}^*$-algebras of the Fell bundles over the isotropy groups. This correspondence is established for certain states on $\mathrm{C}^*(G;\mathcal{A})$ also. While proving this main result, we construct an induction $\mathrm{C}^*$-correspondence between~$\mathrm{C}^*(G;\mathcal{A})$ and the $\mathrm{C}^*$-algebra of an isotropy Fell bundle. We demonstrate our results through many examples such as groupoid crossed products, twisted groupoid crossed products, $G$-spaces and matrix algebras~$\mathrm{M}_n(\mathrm{C}(X))\otimes A$. While studying the matrix algebra~$\mathrm{M}_n(\mathrm{C}(X))$, we propose a groupoid model for it. While demonstrating our main result for this groupoid model, we provide a solution to the Radon--Nikodym problem for the groupoid used in this model.


title: Requirements Quality Research: a harmonized Theory, Evaluation, and Roadmap

abstract: High-quality requirements minimize the risk of propagating defects to later stages of the software development life cycle. Achieving a sufficient level of quality is a major goal of requirements engineering. This requires a clear definition and understanding of requirements quality. Though recent publications make an effort at disentangling the complex concept of quality, the requirements quality research community lacks identity and clear structure which guides advances and puts new findings into an holistic perspective. In this research commentary we contribute (1) a harmonized requirements quality theory organizing its core concepts, (2) an evaluation of the current state of requirements quality research, and (3) a research roadmap to guide advancements in the field. We show that requirements quality research focuses on normative rules and mostly fails to connect requirements quality to its impact on subsequent software development activities, impeding the relevance of the research. Adherence to the proposed requirements quality theory and following the outlined roadmap will be a step towards amending this gap.


title: RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing

abstract: The recent advancements in deep convolutional neural networks have shown significant promise in the domain of road scene parsing. Nevertheless, the existing works focus primarily on freespace detection, with little attention given to hazardous road defects that could compromise both driving safety and comfort. In this paper, we introduce RoadFormer, a novel Transformer-based data-fusion network developed for road scene parsing. RoadFormer utilizes a duplex encoder architecture to extract heterogeneous features from both RGB images and surface normal information. The encoded features are subsequently fed into a novel heterogeneous feature synergy block for effective feature fusion and recalibration. The pixel decoder then learns multi-scale long-range dependencies from the fused and recalibrated heterogeneous features, which are subsequently processed by a Transformer decoder to produce the final semantic prediction. Additionally, we release SYN-UDTIRI, the first large-scale road scene parsing dataset that contains over 10,407 RGB images, dense depth images, and the corresponding pixel-level annotations for both freespace and road defects of different shapes and sizes. Extensive experimental evaluations conducted on our SYN-UDTIRI dataset, as well as on three public datasets, including KITTI road, CityScapes, and ORFD, demonstrate that RoadFormer outperforms all other state-of-the-art networks for road scene parsing. Specifically, RoadFormer ranks first on the KITTI road benchmark. Our source code, created dataset, and demo video are publicly available at mias.group/RoadFormer.


title: Deep Mutual Learning across Task Towers for Effective Multi-Task Recommender Learning

abstract: Recommender systems usually leverage multi-task learning methods to simultaneously optimize several objectives because of the multi-faceted user behavior data. The typical way of conducting multi-task learning is to establish appropriate parameter sharing across multiple tasks at lower layers while reserving a separate task tower for each task at upper layers. Since the task towers exert direct impact on the prediction results, we argue that the architecture of standalone task towers is sub-optimal for promoting positive knowledge sharing. Accordingly, we propose the framework of Deep Mutual Learning across task towers, which is compatible with various backbone multi-task networks. Extensive offline experiments and online AB tests are conducted to evaluate and verify the proposed approach's effectiveness.


title: Cold gas in the heart of Perseus A

abstract: We present new JVLA and VLBA observations tracing the HI in the central region of 3C84 (Perseus A). This radio source is hosted by the bright cluster galaxy NGC 1275 in the centre of the iconic Perseus cluster. With the JVLA, we detected broad (FWHM~500 km/s) HI absorption at arcsecond resolution (~300 pc) centred at the systemic velocity of NGC 1275 against the bright radio continuum, suggesting that the detected gas is very close to the supermassive black hole (SMBH). However, we did not detect any absorption in the higher-resolution VLBA data against the parsec-scale radio core and jet. Based on a comparison of the properties of the HI absorption with those of the molecular circum-nuclear disc (CND) known to be present in NGC 1275, we argue that the HI seen in absorption arises from HI in this fast-rotating CND, and that neutral atomic hydrogen is present as close as ~20 pc from the SMBH. The radio continuum providing the background for absorption arises from non-thermal synchrotron emission from the star formation activity in the CND, whose presence has been reported by earlier VLBA studies. We did not detect any signature that the HI gas is affected by an interaction with the radio jet. Thus, at this stage of the evolution of the source, the impact of the radio jet on the gas in NGC 1275 mainly creates cavities on much larger galaxy scales. Overall, the properties of the CND in Perseus A present strong similarities with Mrk 231, suggesting that, unlike often assumed, HI absorption can arise against the radio emission from star formation in a CND. With the JVLA, we serendipitously detected a new, faint absorbing system that is redshifted by ~2660 km/s, in addition to the already known high-velocity absorption system that is redshifted 2850 km/s with respect to NGC 1275. We identify this new system as gas that is stripped from a foreground galaxy falling into the Perseus cluster.


title: Prompt, Condition, and Generate: Classification of Unsupported Claims with In-Context Learning

abstract: Unsupported and unfalsifiable claims we encounter in our daily lives can influence our view of the world. Characterizing, summarizing, and -- more generally -- making sense of such claims, however, can be challenging. In this work, we focus on fine-grained debate topics and formulate a new task of distilling, from such claims, a countable set of narratives. We present a crowdsourced dataset of 12 controversial topics, comprising more than 120k arguments, claims, and comments from heterogeneous sources, each annotated with a narrative label. We further investigate how large language models (LLMs) can be used to synthesise claims using In-Context Learning. We find that generated claims with supported evidence can be used to improve the performance of narrative classification models and, additionally, that the same model can infer the stance and aspect using a few training examples. Such a model can be useful in applications which rely on narratives , e.g. fact-checking.


title: OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking

abstract: Multiple pedestrian tracking faces the challenge of tracking pedestrians in the presence of occlusion. Existing methods suffer from inaccurate motion estimation, appearance feature extraction, and association due to occlusion, leading to inadequate Identification F1-Score (IDF1), excessive ID switches (IDSw), and insufficient association accuracy and recall (AssA and AssR). We found that the main reason is abnormal detections caused by partial occlusion. In this paper, we suggest that the key insight is explicit motion estimation, reliable appearance features, and fair association in occlusion scenes. Specifically, we propose an adaptive occlusion-aware multiple pedestrian tracker, OccluTrack. We first introduce an abnormal motion suppression mechanism into the Kalman Filter to adaptively detect and suppress outlier motions caused by partial occlusion. Second, we propose a pose-guided re-ID module to extract discriminative part features for partially occluded pedestrians. Last, we design a new occlusion-aware association method towards fair IoU and appearance embedding distance measurement for occluded pedestrians. Extensive evaluation results demonstrate that our OccluTrack outperforms state-of-the-art methods on MOT-Challenge datasets. Particularly, the improvements on IDF1, IDSw, AssA, and AssR demonstrate the effectiveness of our OccluTrack on tracking and association performance.


title: Improving CLIP Robustness with Knowledge Distillation and Self-Training

abstract: This paper examines the robustness of a multi-modal computer vision model, CLIP (Contrastive Language-Image Pretraining), in the context of unsupervised learning. The main objective is twofold: first, to evaluate the robustness of CLIP, and second, to explore strategies for augmenting its robustness. To achieve this, we introduce a novel approach named LP-CLIP. This technique involves the distillation of CLIP features through the incorporation of a linear probing layer positioned atop its encoding structure. This newly added layer is trained utilizing pseudo-labels produced by CLIP, coupled with a self-training strategy. The LP-CLIP technique offers a promising approach to enhance the robustness of CLIP without the need for annotations. By leveraging a simple linear probing layer, we aim to improve the model's ability to withstand various uncertainties and challenges commonly encountered in real-world scenarios. Importantly, our approach does not rely on annotated data, which makes it particularly valuable in situations where labeled data might be scarce or costly to obtain. Our proposed approach increases the robustness of CLIP with SOTA results compared to supervised technique on various datasets.


title: Evaporation-induced temperature gradient in a foam column

abstract: Various parameters affect the foam stability: surface and bulk rheology of the solution, gravitational drainage, mechanical vibrations, bubble gas composition, and also evaporation. Evaporation is often considered through the prism of a liquid loss, but it also induces a cooling effect due to the enthalpy of vaporization. In this study, we combine a theoretical and experimental approach to explore the temperature field in a foam column evaporating from the top. We show that a measurable temperature profile exists in this geometry with temperatures at the interface lower than the environmental temperature by few degrees. We demonstrate that the temperature profile is the result of a balance between the enthalpy of vaporization and heat fluxes originating from the thermal conduction of foam and air and the thermal radiation. For small foam thicknesses compared to the radius, we found that the temperature gradient is established over the foam thickness while for large aspect ratios, the gradient is spanning over a lengthscale comparable to the tube radius.


title: Quantum information spreading and scrambling in a distributed quantum network: A Hasse/Lamport diagrammatic approach

abstract: Large-scale quantum networks, known as quantum internet, hold great promises for advanced distributed quantum computing and long-distance quantum communication. It is essential to have a proper theoretical analysis of the quantum network and explore new applications and protocols that justify building such an extensive network. We propose a novel diagrammatic way of visualizing information flow dynamics within the quantum network, which preserves the causal relationship between different events at different nodes. This facilitates synchronization among network nodes, studies the error propagation, and allows for tracking valuable quantum resources. Additionally, We propose a quantum information scrambling protocol, where a specific node scrambles secret quantum information across the entire network. This protocol ensures that a malicious party would need access to a significant subset of the network to retrieve the information.


title: Is it possible to separate baryonic from dark matter within the $\Lambda$-CDM formalism?

abstract: We found general solutions of matter stress-energy (non-)conservation in scalar-tensor FLRW-type cosmological models by extending the logotropic formalism to the case of non-minimal coupling between the scalar field and new dark fluid candidates. The energy conditions expressed by the generating function are introduced. Next, we investigate the possibility of separating baryonic from dark matter and explain their ratio as a chameleon effect in the presence of non-minimal coupling. To answer the question affirmatively we analyze simple extensions of the $\Lambda$-CDM model by adding a non-minimally coupled scalar field in the Einstein frame. Two scenarios involving either a scalaron (quintessence) or a phantom (ghost) are numerically solved and compared. As a result, it is shown that in both cases LCDM model can be reproduced with a high accuracy in the region covered by observations. As expected, in the case of the phantom (ghost) field the Big-Bang scenario is replaced by the (matter) Bounce.


title: Testable Likelihoods for Beyond-the-Standard Model Fits

abstract: Studying potential BSM effects at the precision frontier requires accurate transfer of information from low-energy measurements to high-energy BSM models. We propose to use normalising flows to construct likelihood functions that achieve this transfer. Likelihood functions constructed in this way provide the means to generate additional samples and admit a ``trivial'' goodness-of-fit test in form of a $\chi^2$ test statistic. Here, we study a particular form of normalising flow, apply it to a multi-modal and non-Gaussian example, and quantify the accuracy of the likelihood function and its test statistic.


title: The Raman gap and collisional absorption

abstract: One of the long-standing puzzles observed in many laser-plasma experiments is the gap in the Raman backscattering spectrum. This gap is characterized by the absence of backscattered light between some critical wavelength and twice the incident laser wavelength. The latter is associated with the absolute Raman instability from the quarter-critical density surface. Supported by particle-in-cell (PIC) simulations, it is suggested that the gap can result from the collisional damping of the backscattered light. A linear analysis of the competition between the Raman growth rate and the damping rate in a non-homogenous plasma predicts the gap's existence and width as a function of the system's parameters. The theory is compared with the PIC simulations and past experiments.


title: Toward efficient resource utilization at edge nodes in federated learning

abstract: Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server. However, computational resource constraints and network communication can become a severe bottleneck for larger model sizes typical for deep learning applications. Edge nodes tend to have limited hardware resources (RAM, CPU), and the network bandwidth and reliability at the edge is a concern for scaling federated fleet applications. In this paper, we propose and evaluate a FL strategy inspired by transfer learning in order to reduce resource utilization on devices, as well as the load on the server and network in each global training round. For each local model update, we randomly select layers to train, freezing the remaining part of the model. In doing so, we can reduce both server load and communication costs per round by excluding all untrained layer weights from being transferred to the server. The goal of this study is to empirically explore the potential trade-off between resource utilization on devices and global model convergence under the proposed strategy. We implement the approach using the federated learning framework FEDn. A number of experiments were carried out over different datasets (CIFAR-10, CASA, and IMDB), performing different tasks using different deep-learning model architectures. Our results show that training the model partially can accelerate the training process, efficiently utilizes resources on-device, and reduce the data transmission by around 75% and 53% when we train 25%, and 50% of the model layers, respectively, without harming the resulting global model accuracy.


title: Worst-Case and Smoothed Analysis of the Hartigan-Wong Method for k-Means Clustering

abstract: We analyze the running time of the Hartigan-Wong method, an old algorithm for the $k$-means clustering problem. First, we construct an instance on the line on which the method can take $2^{\Omega(n)}$ steps to converge, demonstrating that the Hartigan-Wong method has exponential worst-case running time even when $k$-means is easy to solve. As this is in contrast to the empirical performance of the algorithm, we also analyze the running time in the framework of smoothed analysis. In particular, given an instance of $n$ points in $d$ dimensions, we prove that the expected number of iterations needed for the Hartigan-Wong method to terminate is bounded by $k^{12kd}\cdot poly(n, k, d, 1/\sigma)$ when the points in the instance are perturbed by independent $d$-dimensional Gaussian random variables of mean $0$ and standard deviation $\sigma$.


title: GloPro: Globally-Consistent Uncertainty-Aware 3D Human Pose Estimation & Tracking in the Wild

abstract: An accurate and uncertainty-aware 3D human body pose estimation is key to enabling truly safe but efficient human-robot interactions. Current uncertainty-aware methods in 3D human pose estimation are limited to predicting the uncertainty of the body posture, while effectively neglecting the body shape and root pose. In this work, we present GloPro, which to the best of our knowledge the first framework to predict an uncertainty distribution of a 3D body mesh including its shape, pose, and root pose, by efficiently fusing visual clues with a learned motion model. We demonstrate that it vastly outperforms state-of-the-art methods in terms of human trajectory accuracy in a world coordinate system (even in the presence of severe occlusions), yields consistent uncertainty distributions, and can run in real-time.


title: Geometric structure of shallow neural networks and constructive ${\mathcal L}^2$ cost minimization

abstract: In this paper, we approach the problem of cost (loss) minimization in underparametrized shallow neural networks through the explicit construction of upper bounds, without any use of gradient descent. A key focus is on elucidating the geometric structure of approximate and precise minimizers. We consider shallow neural networks with one hidden layer, a ReLU activation function, an ${\mathcal L}^2$ Schatten class (or Hilbert-Schmidt) cost function, input space ${\mathbb R}^M$, output space ${\mathbb R}^Q$ with $Q\leq M$, and training input sample size $N>QM$ that can be arbitrarily large. We prove an upper bound on the minimum of the cost function of order $O(\delta_P)$ where $\delta_P$ measures the signal to noise ratio of training inputs. In the special case $M=Q$, we explicitly determine an exact degenerate local minimum of the cost function, and show that the sharp value differs from the upper bound obtained for $Q\leq M$ by a relative error $O(\delta_P^2)$. The proof of the upper bound yields a constructively trained network; we show that it metrizes a particular $Q$-dimensional subspace in the input space ${\mathbb R}^M$. We comment on the characterization of the global minimum of the cost function in the given context.

categories: cs.LG cs.AI math-ph math.MP math.OC stat.ML


title: Generative AI vs. AGI: The Cognitive Strengths and Weaknesses of Modern LLMs

abstract: A moderately detailed consideration of interactive LLMs as cognitive systems is given, focusing on LLMs circa mid-2023 such as ChatGPT, GPT-4, Bard, Llama, etc.. Cognitive strengths of these systems are reviewed, and then careful attention is paid to the substantial differences between the sort of cognitive system these LLMs are, and the sort of cognitive systems human beings are. It is found that many of the practical weaknesses of these AI systems can be tied specifically to lacks in the basic cognitive architectures according to which these systems are built. It is argued that incremental improvement of such LLMs is not a viable approach to working toward human-level AGI, in practical terms given realizable amounts of compute resources. This does not imply there is nothing to learn about human-level AGI from studying and experimenting with LLMs, nor that LLMs cannot form significant parts of human-level AGI architectures that also incorporate other ideas. Social and ethical matters regarding LLMs are very briefly touched from this perspective, which implies that while care should be taken regarding misinformation and other issues, and economic upheavals will need their own social remedies based on their unpredictable course as with any powerfully impactful technology, overall the sort of policy needed as regards modern LLMs is quite different than would be the case if a more credible approximation to human-level AGI were at hand.


title: Piecewise linear approximation for MILP leveraging piecewise convexity to improve performance

abstract: Mixed integer linear programming (MILP) has seen a sharp rise in use for engineering optimization applications in recent years. Even for initially non-linear problems, it is often the method of choice. Then, the non-linear functions have to be approximated in a way, that allows for an efficient implementation in MILP. To realize adaptive operation planning with MILP unit commitment, piecewise-linear approximations of the functions that describe the operating behavior of devices in the energy system have to be computed. We present an algorithm to compute a piecewise-linear approximation of a multi-variate non-linear function. The algorithm splits the domain into two regions and approximates each region with a set of hyperplanes that can be translated to a convex set of constraints in MILP. The main advantage of this "piecewise-convex approximation" (PwCA) compared to more general piecewise-linear approximation with simplices is that the MILP representation of PwCA requires only one auxiliary binary variable. For this reason, PwCA yields significantly faster solving times in large MILP problems where the MILP representation of certain functions has to be replicated many times, such as in unit commitment. To quantify the impact on solving time, we compare the performance using PwCA with the performance of simplex approximation with logarithmic formulation and show that PCA outperforms the latter by a big margin. For this reason, we conclude that PCA will be a useful tool to set up and solve large MILP problems such as arise in unit commitment and similar engineering optimization problems.


title: A moving least square immersed boundary method for SPH with thin-walled structures

abstract: This paper presents a novel method for smoothed particle hydrodynamics (SPH) with thin-walled structures. Inspired by the direct forcing immersed boundary method, this method employs a moving least square method to guarantee the smoothness of velocity near the structure surface. It simplifies thin-walled structure simulations by eliminating the need for multiple layers of boundary particles, and improves computational accuracy and stability in three-dimensional scenarios. Supportive three-dimensional numerical results are provided, including the impulsively started plate and the flow past a cylinder. Results of the impulsively started test demonstrate that the proposed method obtains smooth velocity and pressure in the, as well as a good match to the references results of the vortex wake development. In addition, results of the flow past cylinder test show that the proposed method avoids mutual interference on both side of the boundary, remains stable for three-dimensional simulations while accurately calculating the forces acting on structure.


title: An N-body/hydrodynamical simulation study of the merging cluster El Gordo: A compelling case for self-interacting dark matter?

abstract: We use a large set N-body/hydrodynamical simulations to study the physical properties of the merging cluster El Gordo. We find that the observed X-ray structures, along with other data, can be matched fairly well by simulations with collision velocities 2,000 kms <= V <= 2,500 kms and impact parameters 600 kpc <= P <= 800 kpc. The mass of the primary is constrained to be between 10^{15} M_sun and ~ 1.6 10^{15} M_sun, in accordance with recent lensing-based mass measurements. Moreover, a returning, post-apocenter, scenario is not supported by our head-on simulations. We considered merger models that incorporate dark matter self-interactions. The simulation results show that the observed spatial offsets between the different mass components are well reproduced in self-interacting dark matter models with an elastic cross-section in the range \sigma_DM/m_X ~ 4 -5 cm^2/gr. In addition, the mean relative line-of-sight radial velocity between the two brightest cluster galaxies is found to be on the order of several hundred km/s. We argue that these findings provide an unambiguous signature of a dark matter behavior that exhibits collisional properties in a very energetic high-redshift cluster collision. The range of allowed values we find for sigma_DM/m_X is, however, inconsistent with present upper limits. To resolve this tension we suggest the possibility that the self-interacting dark matter model used here be considered as only a low order approximation, and that the underlying physical processes that describe the interaction of dark matter in major cluster mergers are more complex than can be adequately represented by the commonly assumed approach based on the scattering of dark matter particles.


title: Pointing out Human Answer Mistakes in a Goal-Oriented Visual Dialogue

abstract: Effective communication between humans and intelligent agents has promising applications for solving complex problems. One such approach is visual dialogue, which leverages multimodal context to assist humans. However, real-world scenarios occasionally involve human mistakes, which can cause intelligent agents to fail. While most prior research assumes perfect answers from human interlocutors, we focus on a setting where the agent points out unintentional mistakes for the interlocutor to review, better reflecting real-world situations. In this paper, we show that human answer mistakes depend on question type and QA turn in the visual dialogue by analyzing a previously unused data collection of human mistakes. We demonstrate the effectiveness of those factors for the model's accuracy in a pointing-human-mistake task through experiments using a simple MLP model and a Visual Language Model.


title: Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks

abstract: Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the ability of fast generalization to few-shot tasks. However, recent works indicate that graph contrastive learning combined with fine-tuning can significantly outperform meta learning methods. Despite the empirical success, there is limited understanding of the reasons behind it. In our study, we first identify two crucial advantages of contrastive learning compared to meta learning, including (1) the comprehensive utilization of graph nodes and (2) the power of graph augmentations. To integrate the strength of both contrastive learning and meta learning on the few-shot node classification tasks, we introduce a new paradigm: Contrastive Few-Shot Node Classification (COLA). Specifically, COLA employs graph augmentations to identify semantically similar nodes, which enables the construction of meta-tasks without the need for label information. Therefore, COLA can utilize all nodes to construct meta-tasks, further reducing the risk of overfitting. Through extensive experiments, we validate the essentiality of each component in our design and demonstrate that COLA achieves new state-of-the-art on all tasks.


title: K-Shortest Simple Paths Using Biobjective Path Search

abstract: In this paper we introduce a new algorithm for the \emph{$k$-Shortest Simple Paths} (\kspp{k}) problem with an asymptotic running time matching the state of the art from the literature. It is based on a black-box algorithm due to \citet{Roditty12} that solves at most $2k$ instances of the \emph{Second Shortest Simple Path} (\kspp{2}) problem without specifying how this is done. We fill this gap using a novel approach: we turn the scalar \kspp{2} into instances of the Biobjective Shortest Path problem. Our experiments on grid graphs and on road networks show that the new algorithm is very efficient in practice.


title: Group Spike and Slab Variational Bayes

abstract: We introduce Group Spike-and-slab Variational Bayes (GSVB), a scalable method for group sparse regression. A fast co-ordinate ascent variational inference (CAVI) algorithm is developed for several common model families including Gaussian, Binomial and Poisson. Theoretical guarantees for our proposed approach are provided by deriving contraction rates for the variational posterior in grouped linear regression. Through extensive numerical studies, we demonstrate that GSVB provides state-of-the-art performance, offering a computationally inexpensive substitute to MCMC, whilst performing comparably or better than existing MAP methods. Additionally, we analyze three real world datasets wherein we highlight the practical utility of our method, demonstrating that GSVB provides parsimonious models with excellent predictive performance, variable selection and uncertainty quantification.


title: PDPCRN: Parallel Dual-Path CRN with Bi-directional Inter-Branch Interactions for Multi-Channel Speech Enhancement

abstract: Multi-channel speech enhancement seeks to utilize spatial information to distinguish target speech from interfering signals. While deep learning approaches like the dual-path convolutional recurrent network (DPCRN) have made strides, challenges persist in effectively modeling inter-channel correlations and amalgamating multi-level information. In response, we introduce the Parallel Dual-Path Convolutional Recurrent Network (PDPCRN). This acoustic modeling architecture has two key innovations. First, a parallel design with separate branches extracts complementary features. Second, bi-directional modules enable cross-branch communication. Together, these facilitate diverse representation fusion and enhanced modeling. Experimental validation on TIMIT datasets underscores the prowess of PDPCRN. Notably, against baseline models like the standard DPCRN, PDPCRN not only outperforms in PESQ and STOI metrics but also boasts a leaner computational footprint with reduced parameters.


title: $L^p$ boundedness of pseudo-differential operators with symbols in $S^{n(\rho-1)/2}_{\rho,1}$

abstract: For symbol $a\in S^{n(\rho-1)/2}_{\rho,1}$ the pseudo-differential operator $T_a$ may not be $L^2$ bounded. However, under some mild extra assumptions on $a$, we show that $T_a$ is bounded from $L^{\infty}$ to $BMO$ and on $L^p$ for $2\leq p<\infty$. A key ingredient in our proof of the $L^{\infty}$-$BMO$ boundedness is that we decompose a cube, use $x$-regularity of the symbol and combine certain $L^2$, $L^\infty$ and $L^{\infty}$-$BMO$ boundedness. We use an almost orthogonality argument to prove an $L^2$ boundedness and then interpolation to obtain the desired $L^p$ boundedness.


title: Near-surface Azimuthal Magnetic Fields and Solar Activity Cycles

abstract: Variations of the azimuthal magnetic fields of the Sun in the 23-25 activity cycles of the activity cycles are considered. To identify azimuthal magnetic fields, the analysis of daily observations of LOS magnetic fields from the regions near the solar limb was performed. It is shown that with a sufficiently large averaging of the data, large-scale structures are distinguished that can be interpreted by horizontal magnetic fields directed along the East-West line. Azimuthal magnetic fields are visible both in the low-latitude zone and at high latitudes. Azimuthal fields at the same latitudes have opposite directions in the northern and southern hemispheres, and also change sign in even and odd cycles of activity. The mechanism of formation of global azimuthal magnetic fields and their role in the cycle of solar activity is discussed. The near-surface azimuthal magnetic field is closely related to the activity cycle. Apparently, the azimuthal field is formed from U-shaped flux tubes of active regions (AR). Due to the presence of the tilt angle AR during differential rotation, the subsurface magnetic fields are pulled in the azimuthal direction. The role of azimuthal magnetic fields in solar activity cycles is considered. A scheme for generating a magnetic field according to a scheme different from Babcock-Leighton dynamo models is proposed.


title: Krylov Complexity of Fermionic and Bosonic Gaussian States

abstract: The concept of \emph{complexity} has become pivotal in multiple disciplines, including quantum information, where it serves as an alternative metric for gauging the chaotic evolution of a quantum state. This paper focuses on \emph{Krylov complexity}, a specialized form of quantum complexity that offers an unambiguous and intrinsically meaningful assessment of the spread of a quantum state over all possible orthogonal bases. Our study is situated in the context of Gaussian quantum states, which are fundamental to both Bosonic and Fermionic systems and can be fully described by a covariance matrix. We show that while the covariance matrix is essential, it is insufficient alone for calculating Krylov complexity due to its lack of relative phase information. Our findings suggest that the relative covariance matrix can provide an upper bound for Krylov complexity for Gaussian quantum states. We also explore the implications of Krylov complexity for theories proposing complexity as a candidate for holographic duality by computing Krylov complexity for the thermofield double States (TFD) and Dirac field.


title: EdgeP4: A P4-Programmable Edge Intelligent Ethernet Switch for Tactile Cyber-Physical Systems

abstract: Tactile Internet based operations, e.g., telesurgery, rely on end-to-end closed loop control for accuracy and corrections. The feedback and control are subject to network latency and loss. We design two edge intelligence algorithms hosted at P4 programmable end switches. These algorithms locally compute and command corrective signals, thereby dispense the feedback signals from traversing the network to the other ends and save on control loop latency and network load. We implement these algorithms entirely on data plane on Netronome Agilio SmartNICs using P4. Our first algorithm, $\textit{pose correction}$, is placed at the edge switch connected to an industrial robot gripping a tool. The round trip between transmitting force sensor array readings to the edge switch and receiving correct tip coordinates at the robot is shown to be less than $100~\mu s$. The second algorithm, $\textit{tremor suppression}$, is placed at the edge switch connected to the human operator. It suppresses physiological tremors of amplitudes smaller than $100~\mu m$ which not only improves the application's performance but also reduces the network load up to $99.9\%$. Our solution allows edge intelligence modules to seamlessly switch between the algorithms based on the tasks being executed at the end hosts.


title: The Critical Conjecture of Wave Equations with Logarithmic Nonlinearity on $\mathbb{H}^2$

abstract: In this paper, we verified the critical conjecture in our previous work \cite{wang2023wave} on two-dimensional hyperbolic space, that is, concerning nonlinear wave equations with logarithmic nonlinearity, which behaves like $\left(\ln {1}/{|u|}\right)^{1-p}|u|$ near $u=0$, on hyperbolic spaces, we demonstrate that the critical power is $p_c(2)=3$, by proving global existence for $p>3$, as well as blow up for $p\in (1,3)$.


title: From sound to meaning in the auditory cortex: A neuronal representation and classification analysis

abstract: The neural mechanisms underlying the comprehension of meaningful sounds are yet to be fully understood. While previous research has shown that the auditory cortex can classify auditory stimuli into distinct semantic categories, the specific contributions of the primary (A1) and the secondary auditory cortex (A2) to this process are not well understood. We used songbirds as a model species, and analyzed their neural responses as they listened to their entire vocal repertoire (\(\sim \)10 types of vocalizations). We first demonstrate that the distances between the call types in the neural representation spaces of A1 and A2 are correlated with their respective distances in the acoustic feature space. Then, we show that while the neural activity in both A1 and A2 is equally informative of the acoustic category of the vocalizations, A2 is significantly more informative of the semantic category of those vocalizations. Additionally, we show that the semantic categories are more separated in A2. These findings suggest that as the incoming signal moves downstream within the auditory cortex, its acoustic information is preserved, whereas its semantic information is enhanced.


title: Guest-induced phase transition leads to polarization enhancement in MHyPbCl3

abstract: We present a detailed first-principles investigation of the structural and polar properties of 3D hybrid perovskite, methylhydrazinium lead chloride, MHyPbCl3, as it transitions from a highly polar Phase-I (high temperature, HT) to less polar Phase-II (low temperature, LT) from the perspective of host/guest interactions. Structurally, the two phases vary in the orientation of the guest and the two differently distorted host layers. The transition character (TC) across the path of phase transition and a relatively high guest-reorientation barrier tells that the transition is primarily governed by guest-reorientation. This overall guest/host transition is interesting because it leads to enhancement in polarization with temperature which is quite unusual. Maximally localized Wannier functions (MLWFs) have been used to probe into the atomistic origin of this enhancement which establishes the leading role of the host atoms, especially those lying in the more distorted octahedral layer, with only a negligible contribution from the guest, despite the fact that it is the primary effect leading to transition. Furthermore, we also find a significant feedback polarization of ~9% that the host distortion induces on the guest. This has a direct effect on the density of states occupied by the guest, which shifts away from the band edge with the increase in the host distortion (for Phase-II guest orientation). Thus the organic cations in 3D perovskites can also have a non-trivial contribution to the optoelectronic properties and exciton binding energies.


title: Balanced norm estimates for $rp$-Finite Element Methods applied to singularly perturbed fourth order boundary value problems

abstract: We establish robust exponential convergence for $rp$-Finite Element Methods (FEMs) applied to fourth order singularly perturbed boundary value problems, in a \emph{balanced norm} which is stronger than the usual energy norm associated with the problem. As a corollary, we get robust exponential convergence in the maximum norm. $r p$ FEMs are simply $p$ FEMs with possible repositioning of the (fixed number of) nodes. This is done for a $C^1$ Galerkin FEM in 1-D, and a $C^0$ mixed FEM in 2-D over domains with smooth boundary. In both cases we utilize the \emph{Spectral Boundary Layer} mesh.


title: SideGAN: 3D-Aware Generative Model for Improved Side-View Image Synthesis

abstract: While recent 3D-aware generative models have shown photo-realistic image synthesis with multi-view consistency, the synthesized image quality degrades depending on the camera pose (e.g., a face with a blurry and noisy boundary at a side viewpoint). Such degradation is mainly caused by the difficulty of learning both pose consistency and photo-realism simultaneously from a dataset with heavily imbalanced poses. In this paper, we propose SideGAN, a novel 3D GAN training method to generate photo-realistic images irrespective of the camera pose, especially for faces of side-view angles. To ease the challenging problem of learning photo-realistic and pose-consistent image synthesis, we split the problem into two subproblems, each of which can be solved more easily. Specifically, we formulate the problem as a combination of two simple discrimination problems, one of which learns to discriminate whether a synthesized image looks real or not, and the other learns to discriminate whether a synthesized image agrees with the camera pose. Based on this, we propose a dual-branched discriminator with two discrimination branches. We also propose a pose-matching loss to learn the pose consistency of 3D GANs. In addition, we present a pose sampling strategy to increase learning opportunities for steep angles in a pose-imbalanced dataset. With extensive validation, we demonstrate that our approach enables 3D GANs to generate high-quality geometries and photo-realistic images irrespective of the camera pose.


title: Principal hierarchy of Infinite-dimensional Frobenius Manifold Underlying the Extended Kadomtsev-Petviashvili Hierarchy

abstract: In this paper, we construct the principal hierarchy of the infinite-dimensional Frobenius manifold underlying the extended Kadomtsev-Petviashvili hierarchy. We show that this hierarchy serves as an extension of the genus zero Whitham hierarchy with one movable pole.


title: A density-fitting implementation of the density-based basis-set correction method

abstract: This work reports an efficient density-fitting implementation of the density-based basis-set correction (DBBSC) method in the MOLPRO software. This method consists in correcting the energy calculated by a wave-function method with a given basis set by an adapted basis-set correction density functional incorporating the short-range electron correlation effects missing in the basis set, resulting in an accelerated convergence to the complete-basis-set limit. Different basis-set correction density-functional approximations are explored and the complementary-auxiliary-basis-set single-excitation correction is added. The method is tested on a benchmark set of reaction energies at the second-order M{\o}ller-Plesset (MP2) level and a comparison with the explicitly correlated MP2-F12 method is provided. The results show that the DBBSC method greatly accelerates the basis convergence of MP2 reaction energies, without reaching the accuracy of the MP2-F12 method but with a lower computational cost.


title: Trust assumptions in voting systems

abstract: Assessing and comparing the security level of different voting systems is non-trivial as the technical means provided for and societal assumptions made about various systems differ significantly. However, trust assumptions concerning the involved parties are present for all voting systems and can be used as a basis for comparison. This paper discusses eight concrete voting systems with different properties, 12 types of parties involved, and seven general security goals set for voting. The emerging trust relations are assessed for their criticality, and the result is used for comparison of the considered systems.


title: Differentiable Quantum Architecture Search for Quantum Reinforcement Learning

abstract: Differentiable quantum architecture search (DQAS) is a gradient-based framework to design quantum circuits automatically in the NISQ era. It was motivated by such as low fidelity of quantum hardware, low flexibility of circuit architecture, high circuit design cost, barren plateau (BP) problem, and periodicity of weights. People used it to address error mitigation, unitary decomposition, and quantum approximation optimization problems based on fixed datasets. Quantum reinforcement learning (QRL) is a part of quantum machine learning and often has various data. QRL usually uses a manually designed circuit. However, the pre-defined circuit needs more flexibility for different tasks, and the circuit design based on various datasets could become intractable in the case of a large circuit. The problem of whether DQAS can be applied to quantum deep Q-learning with various datasets is still open. The main target of this work is to discover the capability of DQAS to solve quantum deep Q-learning problems. We apply a gradient-based framework DQAS on reinforcement learning tasks and evaluate it in two different environments - cart pole and frozen lake. It contains input- and output weights, progressive search, and other new features. The experiments conclude that DQAS can design quantum circuits automatically and efficiently. The evaluation results show significant outperformance compared to the manually designed circuit. Furthermore, the performance of the automatically created circuit depends on whether the super-circuit learned well during the training process. This work is the first to show that gradient-based quantum architecture search is applicable to QRL tasks.


title: Hierarchical Modeling of Spatial Cues via Spherical Harmonics for Multi-Channel Speech Enhancement

abstract: Multi-channel speech enhancement utilizes spatial information from multiple microphones to extract the target speech. However, most existing methods do not explicitly model spatial cues, instead relying on implicit learning from multi-channel spectra. To better leverage spatial information, we propose explicitly incorporating spatial modeling by applying spherical harmonic transforms (SHT) to the multi-channel input. In detail, a hierarchical framework is introduced whereby lower order harmonics capturing broader spatial patterns are estimated first, then combined with higher orders to recursively predict finer spatial details. Experiments on TIMIT demonstrate the proposed method can effectively recover target spatial patterns and achieve improved performance over baseline models, using fewer parameters and computations. Explicitly modeling spatial information hierarchically enables more effective multi-channel speech enhancement.


title: The effective potential for string backgrounds from string geometry theory

abstract: String geometry theory is one of the candidates of the non-perturbative formulation of string theory. In this paper, in the bosonic sector of string geometry theory, we identify perturbative vacua in bosonic string theory, which include general string backgrounds. From fluctuations around these vacua, we derive the path-integrals of perturbative strings on the string backgrounds up to any order. Furthermore, the identification of the perturbative vacua enables us to obtain differential equations that determine an effective potential for string backgrounds. We solve the differential equations and obtain an effective potential explicitly up to the second order. In a generic region, we show that the minimum of the second order potential gives a non-trivial background. This fact supports that the full effective potential can determine the true vacuum in string theory.


title: How (Not) to Understand Weak Measurements of Velocities

abstract: To-date, the most elaborated attempt to complete quantum mechanics by the addition of hidden variables is the de Broglie-Bohm (pilot wave) theory (dBBT). It endows particles with definite positions at all times. Their evolution is governed by a deterministic dynamics. By construction, however, the individual particle trajectories generically defy detectability in principle. Of late, this lore might seem to have been called into question in light of so-called weak measurements. Due to their characteristic weak coupling between the measurement device and the system under study, they permit the experimental probing of quantum systems without essentially disturbing them. It's natural therefore to think that weak measurements of velocity in particular offer to actually observe the particle trajectories. If true, such a claim would not only experimentally demonstrate the incompleteness of quantum mechanics: it would provide support of dBBT in its standard form, singling it out from an infinitude of empirically equivalent alternative choices for the particle dynamics. Here we examine this possibility. Our result is deflationary: weak velocity measurements constitute no new arguments, let alone empirical evidence, in favour of standard dBBT; One mustn't na\"ively identify weak and actual positions. Weak velocity measurements admit of a straightforward standard quantum mechanical interpretation, independent of any commitment to particle trajectories and velocities. This is revealed by a careful reconstruction of the physical arguments on which the description of weak velocity measurements rests. It turns out that for weak velocity measurements to be reliable, one must already presuppose dBBT in its standard form: in this sense, they can provide no new argument, empirical or otherwise, for dBBT and its standard guidance equation.


title: Poster: Control-Flow Integrity in Low-end Embedded Devices

abstract: Embedded, smart, and IoT devices are increasingly popular in numerous everyday settings. Since lower-end devices have the most strict cost constraints, they tend to have few, if any, security features. This makes them attractive targets for exploits and malware. Prior research proposed various security architectures for enforcing security properties for resource-constrained devices, e.g., via Remote Attestation (RA). Such techniques can (statically) verify software integrity of a remote device and detect compromise. However, run-time (dynamic) security, e.g., via Control-Flow Integrity (CFI), is hard to achieve. This work constructs an architecture that ensures integrity of software execution against run-time attacks, such as Return-Oriented Programming (ROP). It is built atop a recently proposed CASU -- a low-cost active Root-of-Trust (RoT) that guarantees software immutability. We extend CASU to support a shadow stack and a CFI monitor to mitigate run-time attacks. This gives some confidence that CFI can indeed be attained even on low-end devices, with minimal hardware overhead.


title: Locally trivial monodromy of moduli spaces of sheaves on K3 surfaces

abstract: In this paper we study monodromy operators on moduli spaces $M_v(S,H)$ of sheaves on K3 surfaces with non-primitive Mukai vectors $v$. If we write $v=mw$, with $m>1$ and $w$ primitive, then our main result is that the inclusion $M_w(S,H)\to M_v(S,H)$ as the most singular locus induces an isomorphism between the monodromy groups of these symplectic varieties, allowing us to extend to the non-primitive case a result of Markman.


title: Adaptive questionnaires for facilitating patient data entry in clinical decision support systems: Methods and application to STOPP/START v2

abstract: Clinical decision support systems are software tools that help clinicians to make medical decisions. However, their acceptance by clinicians is usually rather low. A known problem is that they often require clinicians to manually enter lots of patient data, which is long and tedious. Existing solutions, such as the automatic data extraction from electronic health record, are not fully satisfying, because of low data quality and availability. In practice, many systems still include long questionnaire for data entry. In this paper, we propose an original solution to simplify patient data entry, using an adaptive questionnaire, i.e. a questionnaire that evolves during user interaction, showing or hiding questions dynamically. Considering a rule-based decision support systems, we designed methods for translating the system's clinical rules into display rules that determine the items to show in the questionnaire, and methods for determining the optimal order of priority among the items in the questionnaire. We applied this approach to a decision support system implementing STOPP/START v2, a guideline for managing polypharmacy. We show that it permits reducing by about two thirds the number of clinical conditions displayed in the questionnaire. Presented to clinicians during focus group sessions, the adaptive questionnaire was found "pretty easy to use". In the future, this approach could be applied to other guidelines, and adapted for data entry by patients.


title: Exploiting Causality Signals in Medical Images: A Pilot Study with Empirical Results

abstract: We present a novel technique to discover and exploit weak causal signals directly from images via neural networks for classification purposes. This way, we model how the presence of a feature in one part of the image affects the appearance of another feature in a different part of the image. Our method consists of a convolutional neural network backbone and a causality-factors extractor module, which computes weights to enhance each feature map according to its causal influence in the scene. We develop different architecture variants and empirically evaluate all the models on two public datasets of prostate MRI images and breast histopathology slides for cancer diagnosis. We study the effectiveness of our module both in fully-supervised and few-shot learning, we assess its addition to existing attention-based solutions, we conduct ablation studies, and investigate the explainability of our models via class activation maps. Our findings show that our lightweight block extracts meaningful information and improves the overall classification, together with producing more robust predictions that focus on relevant parts of the image. That is crucial in medical imaging, where accurate and reliable classifications are essential for effective diagnosis and treatment planning.


title: PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training

abstract: Large Language Models (LLMs) are trained with a pre-defined context length, restricting their use in scenarios requiring long inputs. Previous efforts for adapting LLMs to a longer length usually requires fine-tuning with this target length (Full-length fine-tuning), suffering intensive training cost. To decouple train length from target length for efficient context window extension, we propose Positional Skip-wisE (PoSE) training that smartly simulates long inputs using a fixed context window. This is achieved by first dividing the original context window into several chunks, then designing distinct skipping bias terms to manipulate the position indices of each chunk. These bias terms and the lengths of each chunk are altered for every training example, allowing the model to adapt to all positions within target length. Experimental results show that PoSE greatly reduces memory and time overhead compared with Full-length fine-tuning, with minimal impact on performance. Leveraging this advantage, we have successfully extended the LLaMA model to 128k tokens using a 2k training context window. Furthermore, we empirically confirm that PoSE is compatible with all RoPE-based LLMs and position interpolation strategies. Notably, our method can potentially support infinite length, limited only by memory usage in inference. With ongoing progress for efficient inference, we believe PoSE can further scale the context window beyond 128k.


title: On submodules of standard modules

abstract: Consider a standard representation $\sigma$ of a quasi-split reductive p-adic group G. The generalized injectivity conjecture, posed by Casselman--Shahidi, asserts that any generic irreducible subquotient $\pi$ of $\sigma$ is necessarily a subrepresentation of $\sigma$. We will prove this conjecture, improving on the verification for many groups by Dijols. We first replace it by a more general ``standard submodule conjecture", where G does not have to be quasi-split and the genericity of $\pi$ is replaced by the condition that the Langlands parameter of $\pi$ is open. We study this standard submodule conjecture via reduction to Hecke algebras. It does not suffice to pass from G to an affine Hecke algebra, we further reduce to graded Hecke algebras and from there to algebras defined in terms of certain equivariant perverse sheaves. To achieve all these reduction steps one needs mild conditions on the parameters of the involved Hecke algebras, which have been verified for the majority of reductive p-adic groups and are expected to hold in general. It is in the geometric setting of graded Hecke algebras from local systems on nilpotent orbits that we can finally put the ``open" condition on L-parameters to good use. The closure relations between the involved nilpotent orbits provide useful insights in the internal structure of standard modules, which highlight the representations associated with open L-parameters. In the same vein we show that, in the parametrization of irreducible modules of geometric graded Hecke algebras, generic modules always have ``open L-parameters". This leads to a proof of our standard submodule conjecture for graded Hecke algebras of geometric type, which is then transferred to reductive p-adic groups. As a bonus, we obtain that the generalized injectivity conjecture also holds with ``tempered" or ``essentially square-integrable" instead of generic.