title: Two Simple Proofs of M\"uller's Theorem

abstract: Due to M\"{u}ller's theorem, the Kolmogorov complexity of a string was shown to be equal to its quantum Kolmogorov complexity. Thus there are no benefits to using quantum mechanics to compress classical information. The quantitative amount of information in classical sources is invariant to the physical model used. These consequences make this theorem arguably the most important result in the intersection of algorithmic information theory and physics. The original proof is quite extensive. This paper contains two simple proofs of this theorem. This paper also contains new bounds for quantum Kolmogorov complexity with error.


title: Selective linear segmentation for detecting relevant parameter changes

abstract: Change-point processes are one flexible approach to model long time series. We propose a method to uncover which model parameter truly vary when a change-point is detected. Given a set of breakpoints, we use a penalized likelihood approach to select the best set of parameters that changes over time and we prove that the penalty function leads to a consistent selection of the true model. Estimation is carried out via the deterministic annealing expectation-maximization algorithm. Our method accounts for model selection uncertainty and associates a probability to all the possible time-varying parameter specifications. Monte Carlo simulations highlight that the method works well for many time series models including heteroskedastic processes. For a sample of 14 Hedge funds (HF) strategies, using an asset based style pricing model, we shed light on the promising ability of our method to detect the time-varying dynamics of risk exposures as well as to forecast HF returns.


title: Classification under Nuisance Parameters and Generalized Label Shift in Likelihood-Free Inference

abstract: An open scientific challenge is how to classify events with reliable measures of uncertainty, when we have a mechanistic model of the data-generating process but the distribution over both labels and latent nuisance parameters is different between train and target data. We refer to this type of distributional shift as generalized label shift (GLS). Direct classification using observed data $\mathbf{X}$ as covariates leads to biased predictions and invalid uncertainty estimates of labels $Y$. We overcome these biases by proposing a new method for robust uncertainty quantification that casts classification as a hypothesis testing problem under nuisance parameters. The key idea is to estimate the classifier's receiver operating characteristic (ROC) across the entire nuisance parameter space, which allows us to devise cutoffs that are invariant under GLS. Our method effectively endows a pre-trained classifier with domain adaptation capabilities and returns valid prediction sets while maintaining high power. We demonstrate its performance on two challenging scientific problems in biology and astroparticle physics with data from realistic mechanistic models.


title: 3D ferroelectric phase field simulations of polycrystalline multi-phase hafnia and zirconia based ultra-thin films

abstract: HfO$_2$- and ZrO$_2$-based ferroelectric thin films have emerged as promising candidates for the gate oxides of next generation electronic devices. Recent work has experimentally demonstrated that a tetragonal/orthorhombic (t/o-) phase mixture with partially in-plane polarization can lead to negative capacitance (NC) stabilization. However, there is a discrepancy between experiments and the theoretical understanding of domain formation and domain wall motion in these multi-phase, polycrystalline materials. Furthermore, the effect of anisotropic domain wall coupling on NC has not been studied so far. Here we apply 3D phase field simulations of HfO$_2$- and ZrO$_2$-based mixed-phase ultra-thin films on silicon to understand the necessary and beneficial conditions for NC stabilization. We find that smaller ferroelectric grains and a larger angle of the polar axis with respect to the out-of-plane direction enhances the NC effect. Furthermore, we show that theoretically predicted negative domain wall coupling even along only one axis prevents NC stabilization. Therefore, we conclude that topological domain walls play a critical role in experimentally observed NC phenomena in HfO$_2$- and ZrO$_2$-based ferroelectrics.


title: Domain-Agnostic Hardware Fingerprinting-Based Device Identifier for Zero-Trust IoT Security

abstract: Next-generation networks aim for comprehensive connectivity, interconnecting humans, machines, devices, and systems seamlessly. This interconnectivity raises concerns about privacy and security, given the potential network-wide impact of a single compromise. To address this challenge, the Zero Trust (ZT) paradigm emerges as a key method for safeguarding network integrity and data confidentiality. This work introduces EPS-CNN, a novel deep-learning-based wireless device identification framework designed to serve as the device authentication layer within the ZT architecture, with a focus on resource-constrained IoT devices. At the core of EPS-CNN, a Convolutional Neural Network (CNN) is utilized to generate the device identity from a unique RF signal representation, known as the Double-Sided Envelope Power Spectrum (EPS), which effectively captures the device-specific hardware characteristics while ignoring device-unrelated information. Experimental evaluations show that the proposed framework achieves over 99%, 93%, and 95% testing accuracy when tested in same-domain (day, location, and channel), cross-day, and cross-location scenarios, respectively. Our findings demonstrate the superiority of the proposed framework in enhancing the accuracy, robustness, and adaptability of deep learning-based methods, thus offering a pioneering solution for enabling ZT IoT device identification.


title: ML-Enabled Systems Model Deployment and Monitoring: Status Quo and Problems

abstract: [Context] Systems incorporating Machine Learning (ML) models, often called ML-enabled systems, have become commonplace. However, empirical evidence on how ML-enabled systems are engineered in practice is still limited, especially for activities surrounding ML model dissemination. [Goal] We investigate contemporary industrial practices and problems related to ML model dissemination, focusing on the model deployment and the monitoring of ML life cycle phases. [Method] We conducted an international survey to gather practitioner insights on how ML-enabled systems are engineered. We gathered a total of 188 complete responses from 25 countries. We analyze the status quo and problems reported for the model deployment and monitoring phases. We analyzed contemporary practices using bootstrapping with confidence intervals and conducted qualitative analyses on the reported problems applying open and axial coding procedures. [Results] Practitioners perceive the model deployment and monitoring phases as relevant and difficult. With respect to model deployment, models are typically deployed as separate services, with limited adoption of MLOps principles. Reported problems include difficulties in designing the architecture of the infrastructure for production deployment and legacy application integration. Concerning model monitoring, many models in production are not monitored. The main monitored aspects are inputs, outputs, and decisions. Reported problems involve the absence of monitoring practices, the need to create custom monitoring tools, and the selection of suitable metrics. [Conclusion] Our results help provide a better understanding of the adopted practices and problems in practice and support guiding ML deployment and monitoring research in a problem-driven manner.


title: On the Interaction between Software Engineers and Data Scientists when building Machine Learning-Enabled Systems

abstract: In recent years, Machine Learning (ML) components have been increasingly integrated into the core systems of organizations. Engineering such systems presents various challenges from both a theoretical and practical perspective. One of the key challenges is the effective interaction between actors with different backgrounds who need to work closely together, such as software engineers and data scientists. This paper presents an exploratory case study to understand the current interaction and collaboration dynamics between these roles in ML projects. We conducted semi-structured interviews with four practitioners with experience in software engineering and data science of a large ML-enabled system project and analyzed the data using reflexive thematic analysis. Our findings reveal several challenges that can hinder collaboration between software engineers and data scientists, including differences in technical expertise, unclear definitions of each role's duties, and the lack of documents that support the specification of the ML-enabled system. We also indicate potential solutions to address these challenges, such as fostering a collaborative culture, encouraging team communication, and producing concise system documentation. This study contributes to understanding the complex dynamics between software engineers and data scientists in ML projects and provides insights for improving collaboration and communication in this context. We encourage future studies investigating this interaction in other projects.


title: A simple proof of existence of Lagrange multipliers

abstract: In the seminal book M\'echanique analitique, Lagrange, 1788, the notion of a Lagrange multiplier was first introduced in order to study a smooth minimization problem subject to equality constraints. The idea is that, under some regularity assumption, at a solution of the problem, one may associate a new variable (Lagrange multiplier) to each constraint such that an equilibrium equation is satisfied. This concept turned out to be central in studying more general constrained optimization problems and it has lead to the rapid development of nonlinear programming as a field of mathematics since the works of Karush and Kuhn-Tucker, who considered equality and inequality constraints. The usual proofs for the existence of Lagrange multipliers are somewhat cumbersome, relying on the implicit function theorem or duality theory. In the first section of this note we present an elementary proof of existence of Lagrange multipliers in the simplest context, which is easily accessible to a wide variety of readers. In addition, this proof is readily extended to the much more general context of conic constraints, which we present in the second section together with the background properties needed on the projection onto a closed and convex cone.


title: Treatment Effect Estimation Amidst Dynamic Network Interference in Online Gaming Experiments

abstract: The evolving landscape of online multiplayer gaming presents unique challenges in assessing the causal impacts of game features. Traditional A/B testing methodologies fall short due to complex player interactions, leading to violations of fundamental assumptions like the Stable Unit Treatment Value Assumption (SUTVA). Unlike traditional social networks with stable and long-term connections, networks in online games are often dynamic and short-lived. Players are temporarily teamed up for the duration of a game, forming transient networks that dissolve once the game ends. This fleeting nature of interactions presents a new challenge compared with running experiments in a stable social network. This study introduces a novel framework for treatment effect estimation in online gaming environments, considering the dynamic and ephemeral network interference that occurs among players. We propose an innovative estimator tailored for scenarios where a completely randomized experimental design is implemented without explicit knowledge of network structures. Notably, our method facilitates post-hoc interference adjustment on experimental data, significantly reducing the complexities and costs associated with intricate experimental designs and randomization strategies. The proposed framework stands out for its ability to accommodate varying levels of interference, thereby yielding more accurate and robust estimations. Through comprehensive simulations set against a variety of interference scenarios, along with empirical validation using real-world data from a mobile gaming environment, we demonstrate the efficacy of our approach. This study represents a pioneering effort in exploring causal inference in user-randomized experiments impacted by dynamic network effects.


title: Investigating the Impact of SOLID Design Principles on Machine Learning Code Understanding

abstract: [Context] Applying design principles has long been acknowledged as beneficial for understanding and maintainability in traditional software projects. These benefits may similarly hold for Machine Learning (ML) projects, which involve iterative experimentation with data, models, and algorithms. However, ML components are often developed by data scientists with diverse educational backgrounds, potentially resulting in code that doesn't adhere to software design best practices. [Goal] In order to better understand this phenomenon, we investigated the impact of the SOLID design principles on ML code understanding. [Method] We conducted a controlled experiment with three independent trials involving 100 data scientists. We restructured real industrial ML code that did not use SOLID principles. Within each trial, one group was presented with the original ML code, while the other was presented with ML code incorporating SOLID principles. Participants of both groups were asked to analyze the code and fill out a questionnaire that included both open-ended and closed-ended questions on their understanding. [Results] The study results provide statistically significant evidence that the adoption of the SOLID design principles can improve code understanding within the realm of ML projects. [Conclusion] We put forward that software engineering design principles should be spread within the data science community and considered for enhancing the maintainability of ML code.


title: Tidal Dissipation in Giant Planets

abstract: Tidal interactions between moons and planets can have major effects on the orbits, spins, and thermal evolution of the moons. In the Saturn system, tidal dissipation in the planet transfers angular momentum from Saturn to the moons, causing them to migrate outwards. The rate of migration is determined by the mechanism of dissipation within the planet, which is closely tied to the planet's uncertain structure. We review current knowledge of giant planet internal structure and evolution, which has improved thanks to data from the \textit{Juno} and \textit{Cassini} missions. We discuss general principles of tidal dissipation, describing both equilibrium and dynamical tides, and how dissipation can occur in a solid core or a fluid envelope. Finally, we discuss the possibility of resonance locking, whereby a moon can lock into resonance with a planetary oscillation mode, producing enhanced tidal migration relative to classical theories, and possibly explaining recent measurements of moon migration rates.


title: Can participation in a hackathon impact the motivation of software engineering students? A preliminary case study analysis

abstract: [Background] Hackathons are increasingly gaining prominence in Software Engineering (SE) education, lauded for their ability to elevate students' skill sets. [Objective] This paper investigates whether hackathons can impact the motivation of SE students. [Method] We conducted an evaluative case study assessing students' motivations before and after a hackathon, combining quantitative analysis using the Academic Motivation Scale (AMS) and qualitative coding of open-ended responses. [Results] Pre-hackathon findings reveal a diverse range of motivations with an overall acceptance, while post-hackathon responses highlight no statistically significant shift in participants' perceptions. Qualitative findings uncovered themes related to networking, team dynamics, and skill development. From a practical perspective, our findings highlight the potential of hackathons to impact participants' motivation. [Conclusion] While our study enhances the comprehension of hackathons as a motivational tool, it also underscores the need for further exploration of psychometric dimensions in SE educational research.


title: POLARIS: A framework to guide the development of Trustworthy AI systems

abstract: In the ever-expanding landscape of Artificial Intelligence (AI), where innovation thrives and new products and services are continuously being delivered, ensuring that AI systems are designed and developed responsibly throughout their entire lifecycle is crucial. To this end, several AI ethics principles and guidelines have been issued to which AI systems should conform. Nevertheless, relying solely on high-level AI ethics principles is far from sufficient to ensure the responsible engineering of AI systems. In this field, AI professionals often navigate by sight. Indeed, while recommendations promoting Trustworthy AI (TAI) exist, these are often high-level statements that are difficult to translate into concrete implementation strategies. There is a significant gap between high-level AI ethics principles and low-level concrete practices for AI professionals. To address this challenge, our work presents an experience report where we develop a novel holistic framework for Trustworthy AI - designed to bridge the gap between theory and practice - and report insights from its application in an industrial case study. The framework is built on the result of a systematic review of the state of the practice, a survey, and think-aloud interviews with 34 AI practitioners. The framework, unlike most of those already in the literature, is designed to provide actionable guidelines and tools to support different types of stakeholders throughout the entire Software Development Life Cycle (SDLC). Our goal is to empower AI professionals to confidently navigate the ethical dimensions of TAI through practical insights, ensuring that the vast potential of AI is exploited responsibly for the benefit of society as a whole.


title: Conservation laws for a generalized seventh order KdV equation

abstract: In this paper, by applying the multiplier method we obtain a complete classification of low-order local conservation laws for a generalized seventh-order KdV equation depending on seven arbitrary nonzero parameters. We apply the Lie method in order to classify all point symmetries admitted by the equation in terms of the arbitrary parameters. We find that there are no special cases of the parameters for which the equation admits extra symmetries, other than those that can be found by inspection (scaling symmetry and space and time translation symmetries). We consider the reduced ordinary differential equations and we determined all integrating factors of the reduced equation from the combined $x$- and $t$- translation symmetries. Finally, we observe that all integrating factors arise by reduction of the low-order multipliers of the generalized seventh-order KdV equation.


title: Nonlinear Regression Analysis

abstract: Nonlinear regression analysis is a popular and important tool for scientists and engineers. In this article, we introduce theories and methods of nonlinear regression and its statistical inferences using the frequentist and Bayesian statistical modeling and computation. Least squares with the Gauss-Newton method is the most widely used approach to parameters estimation. Under the assumption of normally distributed errors, maximum likelihood estimation is equivalent to least squares estimation. The Wald confidence regions for parameters in a nonlinear regression model are affected by the curvatures in the mean function. Furthermore, we introduce the Newton-Raphson method and the generalized least squares method to deal with variance heterogeneity. Examples of simulation data analysis are provided to illustrate important properties of confidence regions and the statistical inferences using the nonlinear least squares estimation and Bayesian inference.


title: A path method for non-exponential ergodicity of Markov chains and its application for chemical reaction systems

abstract: In this paper, we present criteria for non-exponential ergodicity of continuous-time Markov chains on a countable state space. These criteria can be verified by examining the ratio of transition rates over certain paths. We applied this path method to explore the non-exponential convergence of microscopic biochemical interacting systems. Using reaction network descriptions, we identified special architectures of biochemical systems for non-exponential ergodicity. In essence, we found that reactions forming a cycle in the reaction network can induce non-exponential ergodicity when they significantly dominate other reactions across infinitely many regions of the state space. Interestingly, the special architectures allowed us to construct many detailed balanced and complex balanced biochemical systems that are non-exponentially ergodic. Some of these models are low-dimensional bimolecular systems with few reactions. Thus this work suggests the possibility of discovering or synthesizing stochastic systems arising in biochemistry that possess either detailed balancing or complex balancing and slowly converge to their stationary distribution.


title: Dark matter effects of a black hole with nonsingular Yukawa-modified potential in Einstein-Gauss-Bonnet Gravity

abstract: This paper investigates the contribution of the nonsingular Yukawa-modified potential in the context of four-dimensional Einstein-Gauss-Bonnet (EGB) gravity modeling by a static and spherically symmetric black hole solution. These Yukawa-type corrections are essentially described along two parameters, $\beta$ and $\lambda$, affecting Newton's law of gravity at large distances, and a deformation parameter $\ell_0$, which is essential at short distances. Primarily, the strongest effect is encoded in $\beta$, which alters the total mass of the black hole with additional mass proportional to $\beta\mathcal{M}$, imitating the effects of dark matter at large distances from the black hole. In contrast, the effect due to $\lambda$ is small for astrophysical values. On the other hand, the EGB gravity is ruled by the Gauss-Bonnet (GB) coupling constant $\alpha$, a fundamental parameter of the theory. We pay particular attention to thermodynamic stability, critical orbits, geodesics and quasinormal modes. The results demonstrate stability of the black hole solution for a range of values of the GB coupling constant $\alpha$. Furthermore, this study investigates the null geodesic motion, namely the shadow behavior, providing intriguing results in relation to the size of the black hole shadow.


title: High-Precision Atmospheric Constraints for a Cool T Dwarf from JWST Spectroscopy

abstract: We present observations of the T8 dwarf 2MASS 0415-0935 with JWST's NIRSpec spectrograph using the G395H grating ($\sim$ 2.87 - 5.14 $\mu$m). We perform the first atmospheric retrieval analysis at the maximum spectral resolution of NIRSpec (R$\sim$2700) and combine the spectrum with previous observations to study the 0.9-20 $\mu$m spectral energy distribution. We obtain precise constraints on chemical abundances ($\sim$0.02 dex) for a number of species which complicate our understanding of disequilibrium chemistry, particularly for CO$_{2}$ and PH$_{3}$. Furthermore, we measure a $^{12}$CO/$^{13}$CO ratio of $\sim 97^{+9}_{-8}$, making 2MASS 0415-0935 the coldest ($\sim 760$ K) substellar object outside of our solar system with a measured $^{12}$CO/$^{13}$CO ratio. This work shows promise for similar observations with JWST to provide precise abundances of major chemical species as well as isotopologues, allowing for new tests of our understanding of the formation and atmospheres of substellar objects.


title: KIX: A Metacognitive Generalization Framework

abstract: Humans and other animals aptly exhibit general intelligence behaviors in solving a variety of tasks with flexibility and ability to adapt to novel situations by reusing and applying high level knowledge acquired over time. But artificial agents are more of a specialist, lacking such generalist behaviors. Artificial agents will require understanding and exploiting critical structured knowledge representations. We present a metacognitive generalization framework, Knowledge-Interaction-eXecution (KIX), and argue that interactions with objects leveraging type space facilitate the learning of transferable interaction concepts and generalization. It is a natural way of integrating knowledge into reinforcement learning and promising to act as an enabler for autonomous and generalist behaviors in artificial intelligence systems.


title: Robust Implicit Adaptive Low Rank Time-Stepping Methods for Matrix Differential Equations

abstract: In this work, we develop implicit rank-adaptive schemes for time-dependent matrix differential equations. The dynamic low rank approximation (DLRA) is a well-known technique to capture the dynamic low rank structure based on Dirac-Frenkel time-dependent variational principle. In recent years, it has attracted a lot of attention due to its wide applicability. Our schemes are inspired by the three-step procedure used in the rank adaptive version of the unconventional robust integrator (the so called BUG integrator) for DLRA. First, a prediction (basis update) step is made computing the approximate column and row spaces at the next time level. Second, a Galerkin evolution step is invoked using a base implicit solve for the small core matrix. Finally, a truncation is made according to a prescribed error threshold. Since the DLRA is evolving the differential equation projected on to the tangent space of the low rank manifold, the error estimate of the BUG integrator contains the tangent projection (modeling) error which cannot be easily controlled by mesh refinement. This can cause convergence issue for equations with cross terms. To address this issue, we propose a simple modification, consisting of merging the row and column spaces from the explicit step truncation method together with the BUG spaces in the prediction step. In addition, we propose an adaptive strategy where the BUG spaces are only computed if the residual for the solution obtained from the prediction space by explicit step truncation method, is too large. We prove stability and estimate the local truncation error of the schemes under assumptions. We benchmark the schemes in several tests, such as anisotropic diffusion, solid body rotation and the combination of the two, to show robust convergence properties.


title: Are We Asking the Right Questions?: Designing for Community Stakeholders' Interactions with AI in Policing

abstract: Research into recidivism risk prediction in the criminal legal system has garnered significant attention from HCI, critical algorithm studies, and the emerging field of human-AI decision-making. This study focuses on algorithmic crime mapping, a prevalent yet underexplored form of algorithmic decision support (ADS) in this context. We conducted experiments and follow-up interviews with 60 participants, including community members, technical experts, and law enforcement agents (LEAs), to explore how lived experiences, technical knowledge, and domain expertise shape interactions with the ADS, impacting human-AI decision-making. Surprisingly, we found that domain experts (LEAs) often exhibited anchoring bias, readily accepting and engaging with the first crime map presented to them. Conversely, community members and technical experts were more inclined to engage with the tool, adjust controls, and generate different maps. Our findings highlight that all three stakeholders were able to provide critical feedback regarding AI design and use - community members questioned the core motivation of the tool, technical experts drew attention to the elastic nature of data science practice, and LEAs suggested redesign pathways such that the tool could complement their domain expertise.


title: Scrapping The Web For Early Wildfire Detection

abstract: Early wildfire detection is of the utmost importance to enable rapid response efforts, and thus minimize the negative impacts of wildfire spreads. To this end, we present \Pyro, a web-scraping-based dataset composed of videos of wildfires from a network of cameras that were enhanced with manual bounding-box-level annotations. Our dataset was filtered based on a strategy to improve the quality and diversity of the data, reducing the final data to a set of 10,000 images. We ran experiments using a state-of-the-art object detection model and found out that the proposed dataset is challenging and its use in concordance with other public dataset helps to reach higher results overall. We will make our code and data publicly available.


title: Descanning: From Scanned to the Original Images with a Color Correction Diffusion Model

abstract: A significant volume of analog information, i.e., documents and images, have been digitized in the form of scanned copies for storing, sharing, and/or analyzing in the digital world. However, the quality of such contents is severely degraded by various distortions caused by printing, storing, and scanning processes in the physical world. Although restoring high-quality content from scanned copies has become an indispensable task for many products, it has not been systematically explored, and to the best of our knowledge, no public datasets are available. In this paper, we define this problem as Descanning and introduce a new high-quality and large-scale dataset named DESCAN-18K. It contains 18K pairs of original and scanned images collected in the wild containing multiple complex degradations. In order to eliminate such complex degradations, we propose a new image restoration model called DescanDiffusion consisting of a color encoder that corrects the global color degradation and a conditional denoising diffusion probabilistic model (DDPM) that removes local degradations. To further improve the generalization ability of DescanDiffusion, we also design a synthetic data generation scheme by reproducing prominent degradations in scanned images. We demonstrate that our DescanDiffusion outperforms other baselines including commercial restoration products, objectively and subjectively, via comprehensive experiments and analyses.


title: Absence of breakdown of ferrodark solitons exhibiting snake instability

abstract: We investigate the dynamical stability and real time dynamics of the two-types of ferrodark solitons (FDSs) which occur as topological magnetic domain walls in the easy-plane phase of a quasi-two-dimensional (2D) ferromagnetic spin-1 Bose-Einstein condensate. The type-I FDS has positive inertial mass and exhibits a single dynamical instability that generates in plane spin winding, causing polar-core spin vortex dipoles. The positive inertial mass leads to the elastic oscillations of the soliton under transverse perturbations. The type-II FDS has negative inertial mass and exhibits a snake instability and a spin-twist instability, with the latter involving the generation of out of plane spin winding. Distinct from the normal dynamics of negative mass solitons under long wave length transverse perturbations, the snake instability does not lead to the type-II FDS breaking down. Instead, segments of the type-II FDS convert to type-I and mass vortex dipoles are produced. The resulting hybridized-chain of the two soliton types and vortices exhibits complex 2D soliton dynamics at long times while the vortices remain confined and the topological structure of a magnetic domain wall is preserved.


title: Nonlinear functionals of master equation unravelings

abstract: Unravelings provide a probabilistic representation of solutions of master equations and a method of computation of the density operator dynamics. The trajectories generated by unravelings may also be treated as real -- as in the stochastic collapse models. While averages of linear functionals of the unraveling trajectories can be calculated from the master equation, the situation is different for nonlinear functionals, thanks to the corrections with nonzero expected values, coming from the It\^o formula. Two types of nonlinear functionals are considered here: variance, and entropy. The corrections are calculated explicitly for two types of unravelings, based on Poisson and Wiener processes. In the case of entropy, these corrections are shown to be negative, expressing the localization introduced by the Lindblad operators.


title: Revisiting Early-Learning Regularization When Federated Learning Meets Noisy Labels

abstract: In the evolving landscape of federated learning (FL), addressing label noise presents unique challenges due to the decentralized and diverse nature of data collection across clients. Traditional centralized learning approaches to mitigate label noise are constrained in FL by privacy concerns and the heterogeneity of client data. This paper revisits early-learning regularization, introducing an innovative strategy, Federated Label-mixture Regularization (FLR). FLR adeptly adapts to FL's complexities by generating new pseudo labels, blending local and global model predictions. This method not only enhances the accuracy of the global model in both i.i.d. and non-i.i.d. settings but also effectively counters the memorization of noisy labels. Demonstrating compatibility with existing label noise and FL techniques, FLR paves the way for improved generalization in FL environments fraught with label inaccuracies.


title: Systematic investigation of trace anomaly contribution in nucleon mass

abstract: In this work, under the framework of vector meson dominance model, the trace anomaly contribution value inside neutrons are extracted for the first time based on vector meson photoproduction data. Furthermore, we systematically compare and analyze the trace anomaly contributions of protons and neutrons. The results show that the trace anomaly contributions of protons and neutrons are close, which indirectly confirms that their internal structures and dynamic properties may have certain similarities. In addition, the main factors affecting the extraction of the trace anomaly contribution of nucleons are discussed in detail. This study not only provides a theoretical basis for us to better understand the source of nucleon mass, but also makes a useful exploration and discussion on how to extract the trace anomaly contribution of nucleon more accurately in the future.


title: A Survey on Safe Multi-Modal Learning System

abstract: In the rapidly evolving landscape of artificial intelligence, multimodal learning systems (MMLS) have gained traction for their ability to process and integrate information from diverse modality inputs. Their expanding use in vital sectors such as healthcare has made safety assurance a critical concern. However, the absence of systematic research into their safety is a significant barrier to progress in this field. To bridge the gap, we present the first taxonomy that systematically categorizes and assesses MMLS safety. This taxonomy is structured around four fundamental pillars that are critical to ensuring the safety of MMLS: robustness, alignment, monitoring, and controllability. Leveraging this taxonomy, we review existing methodologies, benchmarks, and the current state of research, while also pinpointing the principal limitations and gaps in knowledge. Finally, we discuss unique challenges in MMLS safety. In illuminating these challenges, we aim to pave the way for future research, proposing potential directions that could lead to significant advancements in the safety protocols of MMLS.


title: Exploring Learning Complexity for Downstream Data Pruning

abstract: The over-parameterized pre-trained models pose a great challenge to fine-tuning with limited computation resources. An intuitive solution is to prune the less informative samples from the fine-tuning dataset. A series of training-based scoring functions are proposed to quantify the informativeness of the data subset but the pruning cost becomes non-negligible due to the heavy parameter updating. For efficient pruning, it is viable to adapt the similarity scoring function of geometric-based methods from training-based to training-free. However, we empirically show that such adaption distorts the original pruning and results in inferior performance on the downstream tasks. In this paper, we propose to treat the learning complexity (LC) as the scoring function for classification and regression tasks. Specifically, the learning complexity is defined as the average predicted confidence of subnets with different capacities, which encapsulates data processing within a converged model. Then we preserve the diverse and easy samples for fine-tuning. Extensive experiments with vision datasets demonstrate the effectiveness and efficiency of the proposed scoring function for classification tasks. For the instruction fine-tuning of large language models, our method achieves state-of-the-art performance with stable convergence, outperforming the full training with only 10\% of the instruction dataset.


title: Dynamic Geometric Connectivity in the Plane with Constant Query Time

abstract: We present the first fully dynamic connectivity data structures for geometric intersection graphs achieving constant query time and sublinear amortized update time for most types of geometric objects in 2D. Our data structures can answer connectivity queries between two objects, as well as "global" connectivity queries (e.g., deciding whether the entire graph is connected). Previously, the data structure by Afshani and Chan (ESA'06) achieved such bounds only in the special case of axis-aligned line segments or rectangles but did not work for arbitrary line segments or disks, whereas the data structures by Chan, P\u{a}tra\c{s}cu and Roditty (FOCS'08) worked for more general classes of geometric objects but required $n^{\Omega(1)}$ query time and could not handle global connectivity queries. Specifically, we obtain new data structures with $O(1)$ query time and amortized update time near $n^{4/5}$, $n^{7/8}$, and $n^{20/21}$ for axis-aligned line segments, disks, and arbitrary line segments respectively. Besides greatly reducing the query time, our data structures also improve the previous update times for axis-aligned line segments by Afshani and Chan (from near $n^{10/11}$ to $n^{4/5}$) and for disks by Chan, P\u{a}tra\c{s}cu, and Roditty (from near $n^{20/21}$ to $n^{7/8}$).


title: Starobinsky Inflation and beyond in Einstein-Cartan Gravity

abstract: We show that various types of scalaron-induced inflation, including the Starobinsky inflation, can be realized in the Einstein-Cartan gravity with the Nieh-Yan term and/or the Holst term. Einstein-Cartan $f(R)$ theory is known not to induce an additional scalar degree of freedom, the scalaron, contrary to the case in the metric formalism. However, there exist geometric quantities other than the Ricci scalar in the Einstein-Cartan gravity, such as the Nieh-Yan and the Holst terms. Once we introduce them in addition to the Ricci scalar and allow general combinations up to their quadratic order, the scalaron can become dynamical to realize inflation. With the rank of the associate matrix of the quadratic part to be one, the models are equivalent to the $\alpha$-attractor inflation and its deformation, including the Starobinsky inflation and quadratic chaotic inflation, etc. For more general cases with the rank greater than one, the models fall into the $k$-essence, realizing the rank one case in a particular limit.


title: Prompting with Divide-and-Conquer Program Makes Large Language Models Discerning to Hallucination and Deception

abstract: Foundation models, such as Large language Models (LLMs), have attracted significant amount of interest due to their large number of applications. However, when handling tasks involving repetitive sub-tasks and/or deceptive contents, such as arithmetic calculation and article-level fake news detection, simple instructional prompts suffer from inaccurate responses. Existing works show that more complicated prompting strategies, such as Chain-of-Thoughts and Least-to-Most, can unlock LLM's powerful capacity in diverse areas. Recent researches reveal that simple divide-and-conquer prompting strategy, i.e. simply dividing the input sequence to multiple sub-inputs, can also substantially improve LLM's performance in some specific tasks such as misinformation detection. In this paper, we aim at examining the utility of divide-and-conquer prompting strategy and answer on which kind of tasks this strategy gets advantages. Specifically, we provide a theoretic analysis to divide-and-conquer prompting strategy and help us identify the specific tasks where DaC prompting can bring performance boost with theoretic guarantee. We then present two cases (large integer arithmetic and fact verification) where experimental results aligns with our theoretic analysis.


title: A note on the $A$-numerical range of semi-Hilbertian operators

abstract: In this paper we explore the relation between the $A$-numerical range and the $A$-spectrum of $A$-bounded operators in the setting of semi-Hilbertian structure. We introduce a new definition of $A$-normal operator and prove that closure of the $A$-numerical range of an $A$-normal operator is the convex hull of the $A$-spectrum. We further prove Anderson's theorem for the sum of $A$-normal and $A$-compact operators which improves and generalizes the existing result on Anderson's theorem for $A$-compact operators. Finally we introduce strongly $A$-numerically closed class of operators and along with other results prove that the class of $A$-normal operators is strongly $A$-numerically closed.


title: High-Performance Multi-Qubit System with Double-Transmon Couplers towards Scalable Superconducting Quantum Computers

abstract: Tunable couplers in superconducting quantum computers have enabled fast and accurate two-qubit gates, with reported high fidelities over 0.99 in various architectures and gate implementation schemes. However, there are few tunable couplers whose performance in multi-qubit systems is clarified, except for the most widely used one: single-transmon coupler (STC). Achieving similar accuracy to isolated two-qubit systems remains challenging due to various undesirable couplings but is necessary for scalability. In this work, we numerically analyze a system of three fixed-frequency qubits coupled via two double-transmon couplers (DTCs) where nearest-neighbor qubits are highly detuned and also next nearest-neighbor ones are nearly resonant. The DTC is a recently proposed tunable coupler, which consists of two fixed-frequency transmons coupled through a common loop with an additional Josephson junction. We find that the DTC can not only reduce undesired residual couplings sufficiently, as well as in isolated two-qubits systems, but also enables implementations of 30-ns CZ gates and 10-ns $\pi/2$ pulses with fidelities of 0.9999 or higher. For comparison, we also investigate the system where the DTCs are replaced by the STCs. The results show that the DTC outperforms the STC in terms of both residual coupling suppression and gate accuracy in the above systems. From these results, we expect that the DTC architecture is promising for realizing high-performance, scalable superconducting quantum computers.


title: Low-Energy Theorems and Linearity Breaking in Anomalous Amplitudes

abstract: This study seeks a better comprehension of anomalies by exploring (n+1)-point perturbative amplitudes in a 2n-dimensional framework. The involved structures combine axial and vector vertices into odd tensors. This configuration enables diverse expressions, considered identities at the integrand level. However, connecting them is not automatic after loop integration, as the divergent nature of amplitudes links to surface terms. The background to this subject is the conflict between the linearity of integration and the translational invariance observed in the context of anomalies. That makes it impossible to simultaneously satisfy all symmetry and linearity properties, constraints that arise through Ward identities and relations among Green functions. Using the method known as Implicit Regularization, we show that trace choices are a means to select the amount of anomaly contributions appearing in each symmetry relation. Such an idea appeared through recipes to take traces in recent works, but we introduce a more complete view. We also emphasize low-energy theorems of finite amplitudes as the source of these violations, proving that the total amount of anomaly remains fixed regardless of any choices.


title: A short proof for Rankin--Cohen brackets and generating operators

abstract: Motivated by the concept of "generating operators" for a countable family of operators introduced in the recent paper (arXiv:2306.16800), we find a method to reconstruct the Rankin--Cohen brackets from a very simple multivariable contour integral, and obtain a new proof of their covariance. We also establish a closed formula of the "generating operator" for the Rankin--Cohen brackets in full generality.


title: Coarse graining correlation matrices according to macrostructures: Financial markets as a paradigm

abstract: We analyze correlation structures in financial markets by coarse graining the Pearson correlation matrices according to market sectors to obtain Guhr matrices using Guhr's correlation method according to Ref. [P. Rinn {\it et. al.}, Europhysics Letters 110, 68003 (2015)]. We compare the results for the evolution of market states and the corresponding transition matrices with those obtained using Pearson correlation matrices. The behavior of market states is found to be similar for both the coarse grained and Pearson matrices. However, the number of relevant variables is reduced by orders of magnitude.


title: Different dependence of narrow H$\alpha$ line luminosity on optical continuum luminosity between starforming galaxies and Type-2 AGN: globally negative AGN feedback in local Type-2 AGN?

abstract: In this manuscript, clues are provided to support globally negative AGN feedback on star formation in the host galaxies of the local low-redshift SDSS Type-2 AGN, based on the different dependence of narrow H$\alpha$ line luminosity $L_{H\alpha}$ on optical continuum luminosity $\lambda L_{cont}$ between the starforming galaxies and the Type-2 AGN. Through the measured $L_{H\alpha}$ and $\lambda L_{cont}$ in SDSS starforming galaxies, there is a strong linear correlation between $\lambda L_{cont}$ and $L_{H\alpha}$, accepted as a standard correlation without effects of AGN activity. Meanwhile, considering apparent contributions of AGN activity to narrow H$\alpha$ line emissions in the Type-2 AGN, the correlation between $\lambda L_{cont}$ and $L_{H\alpha}$ in the SDSS Type-2 AGN leads to statistically lower $L_{H\alpha}$ in the Type-2 AGN than in the starforming galaxies, with significance level higher than 5$\sigma$, even after considering necessary effects (including effects of host galaxy properties), leading to accepted conclusion on the globally negative AGN feedback in the local Type-2 AGN. Meanwhile, properties of Dn(4000) and H$\delta_A$ can provide indirect clues to support the globally negative AGN feedback in the local Type-2 AGN, due to older stellar ages in the Type-2 AGN. Moreover, it is interesting to expect more than 50\% narrow H$\alpha$ emissions globally suppressed in the host galaxies of the Type-2 AGN relative to the starforming galaxies. The results not only support globally negative AGN feedback in the local Type-2 AGN, but also show further clues on the quantification of suppressions of star formation by the globally negative AGN feedback.


title: Model-Based Reconstruction for Joint Estimation of $T_{1}$, $R_{2}^{*}$ and $B_{0}$ Field Maps Using Single-Shot Inversion-Recovery Multi-Echo Radial FLASH

abstract: Purpose: To develop a model-based nonlinear reconstruction for simultaneous water-specific $T_{1}$, $R_{2}^{*}$, $B_{0}$ field and/or fat fraction (FF) mapping using single-shot inversion-recovery (IR) multi-echo radial FLASH. Methods: The proposed model-based reconstruction jointly estimates water-specific $T_{1}$, $R_{2}^{*}$, $B_{0}$ field and/or FF maps, as well as a set of coil sensitivities directly from $k$-space obtained with a single-shot IR multi-echo radial FLASH sequence using blip gradients across echoes. Joint sparsity constraints are exploited on multiple quantitative maps to improve precision. Validations are performed on numerical and NIST phantoms and with in vivo studies of the human brain and liver at 3 T. Results: Numerical phantom studies demonstrate the effects of fat signals in $T_{1}$ estimation and confirm good quantitative accuracy of the proposed method for all parameter maps. NIST phantom results confirm good quantitative $T_{1}$ and $R_{2}^{*}$ accuracy in comparison to Cartesian references. Apart from good quantitative accuracy and precision for multiple parameter maps, in vivo studies show improved image details utilizing the proposed joint estimation. The proposed method can achieve simultaneous water-specific $T_{1}$, $R_{2}^{*}$, $B_{0}$ field and/or FF mapping for brain (0.81 $\times$ 0.81 $\times$ 5 mm$^{3}$) and liver (1.6 $\times$ 1.6 $\times$ 6 mm$^{3}$) imaging within four seconds. Conclusion: The proposed model-based nonlinear reconstruction, in combination with a single-shot IR multi-echo radial FLASH acquisition, enables joint estimation of accurate water-specific $T_{1}$, $R_{2}^{*}$, $B_{0}$ field and/or FF maps within four seconds. The present work is of potential value for specific clinical applications.


title: Principled Preferential Bayesian Optimization

abstract: We study the problem of preferential Bayesian optimization (BO), where we aim to optimize a black-box function with only preference feedback over a pair of candidate solutions. Inspired by the likelihood ratio idea, we construct a confidence set of the black-box function using only the preference feedback. An optimistic algorithm with an efficient computational method is then developed to solve the problem, which enjoys an information-theoretic bound on the total cumulative regret, a first-of-its-kind for preferential BO. This bound further allows us to design a scheme to report an estimated best solution, with a guaranteed convergence rate. Experimental results on sampled instances from Gaussian processes, standard test functions, and a thermal comfort optimization problem all show that our method stably achieves better or competitive performance as compared to the existing state-of-the-art heuristics, which, however, do not have theoretical guarantees on regret bounds or convergence.


title: Bounded-Confidence Models of Opinion Dynamics with Neighborhood Effects

abstract: As people's opinions change, their social networks typically coevolve with them. People are often more susceptible to influence by people with similar opinions than by people with dissimilar opinions. In a bounded-confidence model (BCM) of opinion dynamics, interacting individuals influence each other through dyadic influence if and only if their opinions are sufficiently similar to each other. We introduce `neighborhood BCMs' (NBCMs) that include both the usual dyadic influence and a transitive influence, which models the effect of friends of a friend when determining whether or not an interaction with a friend influences an individual. In this transitive influence, an individual's opinion is influenced by a neighbor when, on average, the opinions of the neighbor's neighbors are sufficiently similar to their own opinion. We formulate neighborhood Deffuant--Weisbuch (NDW) and neighborhood Hegselmann--Krause (NHK) BCMs. We simulate our NDW model on time-independent networks and observe interesting opinion states that cannot occur in an associated baseline DW model. We also simulate our NDW model on adaptive networks that coevolve with opinions by changing its structure through `transitive homophily'. An individual that breaks a tie to one of its neighbors and then rewires that tie to a new individual, with a preference for individuals with a mean neighbor opinion that is closer to that individual's opinion. We explore how the qualitative opinion dynamics and network properties of our time-independent and adaptive NDWM models change as we adjust the relative proportions of dyadic and transitive influence. Finally, we study a two-layer opinion--disease model in which we couple our NDW model with disease spread through a shared adaptive network that can change both on the opinion layer and on the disease layer and we examine how the opinion dynamics affect disease spread.

categories: physics.soc-ph cs.SI math.DS nlin.AO physics.data-an


title: Noise Contrastive Alignment of Language Models with Explicit Rewards

abstract: User intentions are typically formalized as evaluation rewards to be maximized when fine-tuning language models (LMs). Existing alignment methods, such as Direct Preference Optimization (DPO), are mainly tailored for pairwise preference data where rewards are implicitly defined rather than explicitly given. In this paper, we introduce a general framework for LM alignment, leveraging Noise Contrastive Estimation (NCE) to bridge the gap in handling reward datasets explicitly annotated with scalar evaluations. Our framework comprises two parallel algorithms, NCA and InfoNCA, both enabling the direct extraction of an LM policy from reward data as well as preference data. Notably, we show that the DPO loss is a special case of our proposed InfoNCA objective under pairwise preference settings, thereby integrating and extending current alignment theories. By contrasting NCA and InfoNCA, we show that InfoNCA and DPO adjust relative likelihood across different responses to a single instruction, while NCA optimizes absolute likelihood for each response. We apply our methods to align a 7B language model with a GPT-4 annotated reward dataset. Experimental results suggest that InfoNCA surpasses the DPO baseline in GPT-4 evaluations, while NCA enjoys better training stability with competitive performance.


title: Attention as Robust Representation for Time Series Forecasting

abstract: Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism, dynamically fusing embeddings to enhance data representation, often relegating attention weights to a byproduct role. Yet, time series data, characterized by noise and non-stationarity, poses significant forecasting challenges. Our approach elevates attention weights as the primary representation for time series, capitalizing on the temporal relationships among data points to improve forecasting accuracy. Our study shows that an attention map, structured using global landmarks and local windows, acts as a robust kernel representation for data points, withstanding noise and shifts in distribution. Our method outperforms state-of-the-art models, reducing mean squared error (MSE) in multivariate time series forecasting by a notable 3.6% without altering the core neural network architecture. It serves as a versatile component that can readily replace recent patching based embedding schemes in transformer-based models, boosting their performance.


title: Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology

abstract: Recent studies have demonstrated the immense potential of exploiting muscle actuator morphology for natural and robust movement -- in simulation. A validation on real robotic hardware is yet missing. In this study, we emulate muscle actuator properties on hardware in real-time, taking advantage of modern and affordable electric motors. We demonstrate that our setup can emulate a simplified muscle model on a real robot while being controlled by a learned policy. We improve upon an existing muscle model by deriving a damping rule that ensures that the model is not only performant and stable but also tuneable for the real hardware. Our policies are trained by reinforcement learning entirely in simulation, where we show that previously reported benefits of muscles extend to the case of quadruped locomotion and hopping: the learned policies are more robust and exhibit more regular gaits. Finally, we confirm that the learned policies can be executed on real hardware and show that sim-to-real transfer with real-time emulated muscles on a quadruped robot is possible. These results show that artificial muscles can be highly beneficial actuators for future generations of robust legged robots.


title: Reduced-order modeling of unsteady fluid flow using neural network ensembles

abstract: The use of deep learning has become increasingly popular in reduced-order models (ROMs) to obtain low-dimensional representations of full-order models. Convolutional autoencoders (CAEs) are often used to this end as they are adept at handling data that are spatially distributed, including solutions to partial differential equations. When applied to unsteady physics problems, ROMs also require a model for time-series prediction of the low-dimensional latent variables. Long short-term memory (LSTM) networks, a type of recurrent neural network useful for modeling sequential data, are frequently employed in data-driven ROMs for autoregressive time-series prediction. When making predictions at unseen design points over long time horizons, error propagation is a frequently encountered issue, where errors made early on can compound over time and lead to large inaccuracies. In this work, we propose using bagging, a commonly used ensemble learning technique, to develop a fully data-driven ROM framework referred to as the CAE-eLSTM ROM that uses CAEs for spatial reconstruction of the full-order model and LSTM ensembles for time-series prediction. When applied to two unsteady fluid dynamics problems, our results show that the presented framework effectively reduces error propagation and leads to more accurate time-series prediction of latent variables at unseen points.


title: Unleashing the Infinity Power of Geometry: A Novel Geometry-Aware Transformer (GOAT) for Whole Slide Histopathology Image Analysis

abstract: The histopathology analysis is of great significance for the diagnosis and prognosis of cancers, however, it has great challenges due to the enormous heterogeneity of gigapixel whole slide images (WSIs) and the intricate representation of pathological features. However, recent methods have not adequately exploited geometrical representation in WSIs which is significant in disease diagnosis. Therefore, we proposed a novel weakly-supervised framework, Geometry-Aware Transformer (GOAT), in which we urge the model to pay attention to the geometric characteristics within the tumor microenvironment which often serve as potent indicators. In addition, a context-aware attention mechanism is designed to extract and enhance the morphological features within WSIs.


title: CIC: A framework for Culturally-aware Image Captioning

abstract: Image Captioning generates descriptive sentences from images using Vision-Language Pre-trained models (VLPs) such as BLIP, which has improved greatly. However, current methods lack the generation of detailed descriptive captions for the cultural elements depicted in the images, such as the traditional clothing worn by people from Asian cultural groups. In this paper, we propose a new framework, \textbf{Culturally-aware Image Captioning (CIC)}, that generates captions and describes cultural elements extracted from cultural visual elements in images representing cultures. Inspired by methods combining visual modality and Large Language Models (LLMs) through appropriate prompts, our framework (1) generates questions based on cultural categories from images, (2) extracts cultural visual elements from Visual Question Answering (VQA) using generated questions, and (3) generates culturally-aware captions using LLMs with the prompts. Our human evaluation conducted on 45 participants from 4 different cultural groups with a high understanding of the corresponding culture shows that our proposed framework generates more culturally descriptive captions when compared to the image captioning baseline based on VLPs. Our code and dataset will be made publicly available upon acceptance.


title: Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Models

abstract: The success of recent text-to-image diffusion models is largely due to their capacity to be guided by a complex text prompt, which enables users to precisely describe the desired content. However, these models struggle to effectively suppress the generation of undesired content, which is explicitly requested to be omitted from the generated image in the prompt. In this paper, we analyze how to manipulate the text embeddings and remove unwanted content from them. We introduce two contributions, which we refer to as $\textit{soft-weighted regularization}$ and $\textit{inference-time text embedding optimization}$. The first regularizes the text embedding matrix and effectively suppresses the undesired content. The second method aims to further suppress the unwanted content generation of the prompt, and encourages the generation of desired content. We evaluate our method quantitatively and qualitatively on extensive experiments, validating its effectiveness. Furthermore, our method is generalizability to both the pixel-space diffusion models (i.e. DeepFloyd-IF) and the latent-space diffusion models (i.e. Stable Diffusion).


title: Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language Models

abstract: Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence prefixes during the pre-training phase, existing zero-shot CoT prompting methods that employ identical CoT prompting across all task instances may not be optimal. In this paper, we introduce a novel zero-shot prompting method that leverages evolutionary algorithms to generate diverse promptings for LLMs dynamically. Our approach involves initializing two CoT promptings, performing evolutionary operations based on LLMs to create a varied set, and utilizing the LLMs to select a suitable CoT prompting for a given problem. Additionally, a rewriting operation, guided by the selected CoT prompting, enhances the understanding of the LLMs about the problem. Extensive experiments conducted across ten reasoning datasets demonstrate the superior performance of our proposed method compared to current zero-shot CoT prompting methods on GPT-3.5-turbo and GPT-4. Moreover, in-depth analytical experiments underscore the adaptability and effectiveness of our method in various reasoning tasks.


title: Association between Sitting Time and Urinary Incontinence in the US Population: data from the National Health and Nutrition Examination Survey (NHANES) 2007 to 2018

abstract: Background Urinary incontinence (UI) is a common health problem that affects the life and health quality of millions of people in the US. We aimed to investigate the association between sitting time and UI. Methods Across-sectional survey of adult participants of National Health and Nutrition Examination Survey 2007-2018 was performed. Weighted multivariable logistic and regression models were conducted to assess the association between sitting time and UI. Results A total of 22916 participants were enrolled. Prolonged sitting time was associated with urgent UI (UUI, Odds ratio [OR] = 1.184, 95% Confidence interval [CI] = 1.076 to 1.302, P = 0.001). Compared with patients with sitting time shorter than 7 hours, moderate activity increased the risk of prolonged sitting time over 7 hours in the fully-adjusted model (OR = 2.537, 95% CI = 1.419 to 4.536, P = 0.002). Sitting time over 7 hours was related to male mixed UI (MUI, OR = 1.581, 95% CI = 1.129 to 2.213, P = 0.010), and female stress UI (SUI, OR = 0.884, 95% CI = 0.795 to 0.983, P = 0.026) in the fully-adjusted model. Conclusions Prolonged sedentary sitting time (> 7 hours) indicated a high risk of UUI in all populations, female SUI and male MUI. Compared with sitting time shorter than 7 hours, the moderate activity could not reverse the risk of prolonged sitting, which warranted further studies for confirmation.


title: Graph Neural Networks for Physical-Layer Security in Multi-User Flexible-Duplex Networks

abstract: This paper explores Physical-Layer Security (PLS) in Flexible Duplex (FlexD) networks, considering scenarios involving eavesdroppers. Our investigation revolves around the intricacies of the sum secrecy rate maximization problem, particularly when faced with coordinated and distributed eavesdroppers employing a Minimum Mean Square Error (MMSE) receiver. Our contributions include an iterative classical optimization solution and an unsupervised learning strategy based on Graph Neural Networks (GNNs). To the best of our knowledge, this work marks the initial exploration of GNNs for PLS applications. Additionally, we extend the GNN approach to address the absence of eavesdroppers' channel knowledge. Extensive numerical simulations highlight FlexD's superiority over Half-Duplex (HD) communications and the GNN approach's superiority over the classical method in both performance and time complexity.


title: Tradeoffs of Diagonal Fisher Information Matrix Estimators

abstract: The Fisher information matrix characterizes the local geometry in the parameter space of neural networks. It elucidates insightful theories and useful tools to understand and optimize neural networks. Given its high computational cost, practitioners often use random estimators and evaluate only the diagonal entries. We examine two such estimators, whose accuracy and sample complexity depend on their associated variances. We derive bounds of the variances and instantiate them in regression and classification networks. We navigate trade-offs of both estimators based on analytical and numerical studies. We find that the variance quantities depend on the non-linearity with respect to different parameter groups and should not be neglected when estimating the Fisher information.


title: Generators for the cohomology of the moduli space of irregular parabolic Higgs bundles

abstract: We prove that the pure part of the cohomology ring of the moduli space of irregular $\underline{\xi}$-parabolic Higgs bundles is generated by the K\"{u}nneth components of the Chern classes of a universal bundle and the Chern classes of the successive quotients of a universal flag of subbundles. As an application, in the regular full-flag case, we demonstrate a similar result for the cohomology ring of the moduli spaces of parabolic and strongly parabolic Higgs bundles.


title: Palindromic Periodicities

abstract: A palindromic periodicity is a factor of an infinite word $(ps)^\omega$ where $p$ and $s$ are palindromes and the factor has length at least $|ps|$, for example, $accabaccab$. In this paper we describe several ways in which a palindromic periodicity may arise through the interaction of palindromes and periodicity, the simplest case being when a palindrome is itself periodic. We then consider what happens when a word is a palindromic periodicity in two ways, a situation similar to that considered in the Fine and Wilf Lemma and obtain something slightly stronger than that lemma. The paper ends with suggestions for further work.


title: Task-customized Masked AutoEncoder via Mixture of Cluster-conditional Experts

abstract: Masked Autoencoder~(MAE) is a prevailing self-supervised learning method that achieves promising results in model pre-training. However, when the various downstream tasks have data distributions different from the pre-training data, the semantically irrelevant pre-training information might result in negative transfer, impeding MAE's scalability. To address this issue, we propose a novel MAE-based pre-training paradigm, Mixture of Cluster-conditional Experts (MoCE), which can be trained once but provides customized pre-training models for diverse downstream tasks. Different from the mixture of experts (MoE), our MoCE trains each expert only with semantically relevant images by using cluster-conditional gates. Thus, each downstream task can be allocated to its customized model pre-trained with data most similar to the downstream data. Experiments on a collection of 11 downstream tasks show that MoCE outperforms the vanilla MAE by 2.45\% on average. It also obtains new state-of-the-art self-supervised learning results on detection and segmentation.


title: First measurement of the yield of $^8$He isotopes produced in liquid scintillator by cosmic-ray muons at Daya Bay

abstract: Daya Bay presents the first measurement of cosmogenic $^8$He isotope production in liquid scintillator, using an innovative method for identifying cascade decays of $^8$He and its child isotope, $^8$Li. We also measure the production yield of $^9$Li isotopes using well-established methodology. The results, in units of 10$^{-8}\mu^{-1}$g$^{-1}$cm$^{2}$, are 0.307$\pm$0.042, 0.341$\pm$0.040, and 0.546$\pm$0.076 for $^8$He, and 6.73$\pm$0.73, 6.75$\pm$0.70, and 13.74$\pm$0.82 for $^9$Li at average muon energies of 63.9~GeV, 64.7~GeV, and 143.0~GeV, respectively. The measured production rate of $^8$He isotopes is more than an order of magnitude lower than any other measurement of cosmogenic isotope production. It replaces the results of previous attempts to determine the ratio of $^8$He to $^9$Li production that yielded a wide range of limits from 0 to 30\%. The results provide future liquid-scintillator-based experiments with improved ability to predict cosmogenic backgrounds.


title: Efficient Nonparametric Inference of Causal Mediation Effects with Nonignorable Missing Confounders

abstract: We consider causal mediation analysis with confounders subject to nonignorable missingness in a nonparametric framework. Our approach relies on shadow variables that are associated with the missing confounders but independent of the missingness mechanism. The mediation effect of interest is shown to be a weighted average of an iterated conditional expectation, which motivates our Sieve-based Iterative Outward (SIO) estimator. We derive the rate of convergence and asymptotic normality of the SIO estimator, which do not suffer from the ill-posed inverse problem. Essentially, we show that the asymptotic normality is not affected by the slow convergence rate of nonparametric estimators of nuisance functions. Moreover, we demonstrate that our estimator is locally efficient and attains the semiparametric efficiency bound under certain conditions. We accurately depict the efficiency loss attributable to missingness and identify scenarios in which efficiency loss is absent. We also propose a stable and easy-to-implement approach to estimate asymptotic variance and construct confidence intervals for the mediation effects. Finally, we evaluate the finite-sample performance of our proposed approach through simulation studies, and apply it to the CFPS data to show its practical applicability.


title: Zeroth-order Low-rank Hessian Estimation via Matrix Recovery

abstract: A zeroth-order Hessian estimator aims to recover the Hessian matrix of an objective function at any given point, using minimal finite-difference computations. This paper studies zeroth-order Hessian estimation for low-rank Hessians, from a matrix recovery perspective. Our challenge lies in the fact that traditional matrix recovery techniques are not directly suitable for our scenario. They either demand incoherence assumptions (or its variants), or require an impractical number of finite-difference computations in our setting. To overcome these hurdles, we employ zeroth-order Hessian estimations aligned with proper matrix measurements, and prove new recovery guarantees for these estimators. More specifically, we prove that for a Hessian matrix $H \in \mathbb{R}^{n \times n}$ of rank $r$, $ \mathcal{O}(nr^2 \log^2 n ) $ proper zeroth-order finite-difference computations ensures a highly probable exact recovery of $H$. Compared to existing methods, our method can greatly reduce the number of finite-difference computations, and does not require any incoherence assumptions.


title: Exploring the faintest end of mid-infrared luminosity functions up to $z\simeq 5$ with the JWST CEERS survey

abstract: Mid-infrared (MIR) light from galaxies is sensitive to dust-obscured star-formation activities because it traces the characteristic emission of dust heated by young, massive stars. By constructing the MIR luminosity functions (LFs), we are able to quantify the overall dusty star formation history and the evolution of galaxies over cosmic time. In this work, we report the first rest-frame MIR LFs at 7.7, 10, 12.8, 15, 18, and 21 $\mu$m as well as the total IR LF from the James Webb Space Telescope (JWST) Cosmic Evolution Early Release Science (CEERS) survey. We identify 506 galaxies at $z=0-5.1$ in the CEERS survey that also have optical photometry from the Hubble Space Telescope. With the unprecedented sensitivity of the JWST, we probe the faintest end of the LFs at $z=0-1$ down to $L^* \sim 10^7 L_\odot$, $\sim 2$ orders of magnitude fainter than those from the previous generation of IR space telescopes. Our findings connect well with and continue the faint end of the MIR LFs from the deepest observations in past works. As a proxy of star formation history, we present the MIR-based luminosity density up to $z\simeq4.0$, marking the first probe of the early Universe by JWST MIRI.


title: Can Channels be Fully Inferred Between Two Antenna Panels?

abstract: This letter considers a two-panel massive multiple-input multiple-output (MIMO) communication system, where the base station (BS) is equipped with two antenna panels that may use different frequency bands for communication. By exploiting the geometric relationships between antenna panels, efficient channel inference methods across antenna panels are proposed to reduce the overhead of real-time channel estimation. Four scenarios are considered, namely far-field free-space, near-field free-space, multi-path sharing far-field scatterers, and multi-path sharing near-field scatterers. For both far-field and near-field free-space scenarios, we show that the channel of one panel can be fully inferred from that of the other panel, as long as the multi-path components (MPCs) composing the channel can be resolved. On the other hand, for the multi-path scenarios sharing far-field or near-field scatterers, only the angles or range of angles of the MPCs can be inferred, respectively. Simulation results based on commercial 3D ray-tracing software are presented to validate our developed channel inference techniques.


title: Form-From: A Design Space of Social Media Systems

abstract: Social media systems are as varied as they are pervasive. They have been almost universally adopted for a broad range of purposes including work, entertainment, activism, and decision making. As a result, they have also diversified, with many distinct designs differing in content type, organization, delivery mechanism, access control, and many other dimensions. In this work, we aim to characterize and then distill a concise design space of social media systems that can help us understand similarities and differences, recognize potential consequences of design choices, and identify spaces for innovation. Our model, which we call Form-From, characterizes social media based on (1) the form of the content, either threaded or flat, and (2) from where or from whom one might receive content, ranging from spaces to networks to the commons. We derive Form-From inductively from a larger set of 62 dimensions organized into 10 categories. To demonstrate the utility of our model, we trace the history of social media systems as they traverse the Form-From space over time, and we identify common design patterns within cells of the model.


title: Block Mott insulating state induced by next-nearest neighbor hopping in the S = 3/2 zigzag chain BaCoTe2O7

abstract: Quasi-one-dimensional correlated electronic multi-orbital systems with either ladder or chain geometries continue attracting considerable interest due to their complex electronic phases arising from the interplay of the hopping matrix, the crystal-fields splitting, the electronic correlations, and strong quantum fluctuations. Recently, the intriguing cobalt zigzag chain system BaCoTe$_2$O$_7$, with electronic density $n = 7$, was prepared experimentally. Here, we systematically study the electronic and magnetic properties of this quasi-one-dimensional compound from the theory perspective. Based on first-principles density functional theory calculations, strongly anisotropic one-dimensional electronic Co $3d$ bands were found near the Fermi level. By evaluating the relevant hopping amplitudes, we provide the magnitude and origin of the nearest-neighbor (NN) and next nearest-neighbor (NNN) hopping matrices in BaCoTe$_2$O$_7$. With this information, we constructed a three-orbital electronic Hubbard model for this zigzag chain system, and studied two cases: with only a NN hopping matrix, and with NN plus NNN hopping matrices. Introducing the Hubbard and Hund couplings and studying the model via the density matrix renormalization group method, we constructed the ground-state phase diagram. A robust staggered antiferromagnetic (AFM) region was found when only the NN hopping matrix in the chain direction was employed. However, for the realistic case where the NNN hopping matrix is also included, the dominant state becomes instead a block AFM order, in agreement with experiments. The system displays Mott insulator characteristics with three half-filled orbitals, when the block AFM order is stable. Our results for BaCoTe$_2$O$_7$ provide guidance to experimentalists and theorists working on this zigzag one-dimensional chain and related materials.


title: Integrated Sensing and Communication Driven Digital Twin for Intelligent Machine Network

abstract: Intelligent machines (IMs), including industrial machines, unmanned aerial vehicles (UAVs), and unmanned vehicles, etc., could perform effective cooperation in complex environment when they form IM network. The efficient environment sensing and communication are crucial for IM network, enabling the real-time and stable control of IMs. With the emergence of integrated sensing and communication (ISAC) technology, IM network is empowered with ubiquitous sensing capabilities, which is helpful in improving the efficiency of communication and sensing with the mutual benefit of them. However, the massive amount of sensing information brings challenges for the processing, storage and application of sensing information. In this article, ISAC driven digital twin (DT) is proposed for IM network, and the architecture and enabling technologies are revealed. ISAC driven DT structurally stores the sensing information, which is further applied to optimize communication, networking and control schemes of IMs, promoting the widespread applications of IMs.


title: Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

abstract: Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300 articles, focusing on KG-aware research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph (MM4KG), which extends KG studies into the MMKG realm. We begin by defining KGs and MMKGs, then explore their construction progress. Our review includes two primary task categories: KG-aware multi-modal learning tasks, such as Image Classification and Visual Question Answering, and intrinsic MMKG tasks like Multi-modal Knowledge Graph Completion and Entity Alignment, highlighting specific research trajectories. For most of these tasks, we provide definitions, evaluation benchmarks, and additionally outline essential insights for conducting relevant research. Finally, we discuss current challenges and identify emerging trends, such as progress in Large Language Modeling and Multi-modal Pre-training strategies. This survey aims to serve as a comprehensive reference for researchers already involved in or considering delving into KG and multi-modal learning research, offering insights into the evolving landscape of MMKG research and supporting future work.


title: The AGORA High-resolution Galaxy Simulations Comparison Project. V: Satellite Galaxy Populations In A Cosmological Zoom-in Simulation of A Milky Way-mass Halo

abstract: We analyze and compare the satellite halo populations at $z\sim2$ in the high-resolution cosmological zoom-in simulations of a $10^{12}\,{\rm M}_{\odot}$ target halo ($z=0$ mass) carried out on eight widely-used astrophysical simulation codes ({\sc Art-I}, {\sc Enzo}, {\sc Ramses}, {\sc Changa}, {\sc Gadget-3}, {\sc Gear}, {\sc Arepo-t}, and {\sc Gizmo}) for the {\it AGORA} High-resolution Galaxy Simulations Comparison Project. We use slightly different redshift epochs near $z=2$ for each code (hereafter ``$z\sim2$') at which the eight simulations are in the same stage in the target halo's merger history. After identifying the matched pairs of halos between the {\it CosmoRun} simulations and the DMO simulations, we discover that each {\it CosmoRun} halo tends to be less massive than its DMO counterpart. When we consider only the halos containing stellar particles at $z\sim2$, the number of satellite {\it galaxies} is significantly fewer than that of dark matter halos in all participating {\it AGORA} simulations, and is comparable to the number of present-day satellites near the Milky Way or M31. The so-called ``missing satellite problem' is fully resolved across all participating codes simply by implementing the common baryonic physics adopted in {\it AGORA} and the stellar feedback prescription commonly used in each code, with sufficient numerical resolution ($\lesssim100$ proper pc at $z=2$). We also compare other properties such as the stellar mass$-$halo mass relation and the mass$-$metallicity relation. Our work highlights the value of comparison studies such as {\it AGORA}, where outstanding problems in galaxy formation theory are studied simultaneously on multiple numerical platforms.


title: The bifurcation structure within robust chaos for two-dimensional piecewise-linear maps

abstract: We study two-dimensional, two-piece, piecewise-linear maps having two saddle fixed points. Such maps reduce to a four-parameter family and are well known to have a chaotic attractor throughout open regions of parameter space. The purpose of this paper is to determine where and how this attractor undergoes bifurcations. We explore the bifurcation structure numerically by using Eckstein's greatest common divisor algorithm to estimate from sample orbits the number of connected components in the attractor. Where the map is orientation-preserving the numerical results agree with formal results obtained previously through renormalisation. Where the map is orientation-reversing or non-invertible the same renormalisation scheme appears to generate the bifurcation boundaries, but here we need to account for the possibility of some stable low-period solutions. Also the attractor can be destroyed in novel heteroclinic bifurcations (boundary crises) that do not correspond to simple algebraic constraints on the parameters. Overall the results reveal a broadly similar component-doubling bifurcation structure in the orientation-reversing and non-invertible settings, but with some additional complexities.


title: Enhancing Zero-shot Counting via Language-guided Exemplar Learning

abstract: Recently, Class-Agnostic Counting (CAC) problem has garnered increasing attention owing to its intriguing generality and superior efficiency compared to Category-Specific Counting (CSC). This paper proposes a novel ExpressCount to enhance zero-shot object counting by delving deeply into language-guided exemplar learning. Specifically, the ExpressCount is comprised of an innovative Language-oriented Exemplar Perceptron and a downstream visual Zero-shot Counting pipeline. Thereinto, the perceptron hammers at exploiting accurate exemplar cues from collaborative language-vision signals by inheriting rich semantic priors from the prevailing pre-trained Large Language Models (LLMs), whereas the counting pipeline excels in mining fine-grained features through dual-branch and cross-attention schemes, contributing to the high-quality similarity learning. Apart from building a bridge between the LLM in vogue and the visual counting tasks, expression-guided exemplar estimation significantly advances zero-shot learning capabilities for counting instances with arbitrary classes. Moreover, devising a FSC-147-Express with annotations of meticulous linguistic expressions pioneers a new venue for developing and validating language-based counting models. Extensive experiments demonstrate the state-of-the-art performance of our ExpressCount, even showcasing the accuracy on par with partial CSC models.


title: Efficient Estimation for Functional Accelerated Failure Time Model

abstract: We propose a functional accelerated failure time model to characterize effects of both functional and scalar covariates on the time to event of interest, and provide regularity conditions to guarantee model identifiability. For efficient estimation of model parameters, we develop a sieve maximum likelihood approach where parametric and nonparametric coefficients are bundled with an unknown baseline hazard function in the likelihood function. Not only do the bundled parameters cause immense numerical difficulties, but they also result in new challenges in theoretical development. By developing a general theoretical framework, we overcome the challenges arising from the bundled parameters and derive the convergence rate of the proposed estimator. Furthermore, we prove that the finite-dimensional estimator is $\sqrt{n}$-consistent, asymptotically normal and achieves the semiparametric information bound. The proposed inference procedures are evaluated by extensive simulation studies and illustrated with an application to the sequential organ failure assessment data from the Improving Care of Acute Lung Injury Patients study.


title: TASER: Temporal Adaptive Sampling for Fast and Accurate Dynamic Graph Representation Learning

abstract: Recently, Temporal Graph Neural Networks (TGNNs) have demonstrated state-of-the-art performance in various high-impact applications, including fraud detection and content recommendation. Despite the success of TGNNs, they are prone to the prevalent noise found in real-world dynamic graphs like time-deprecated links and skewed interaction distribution. The noise causes two critical issues that significantly compromise the accuracy of TGNNs: (1) models are supervised by inferior interactions, and (2) noisy input induces high variance in the aggregated messages. However, current TGNN denoising techniques do not consider the diverse and dynamic noise pattern of each node. In addition, they also suffer from the excessive mini-batch generation overheads caused by traversing more neighbors. We believe the remedy for fast and accurate TGNNs lies in temporal adaptive sampling. In this work, we propose TASER, the first adaptive sampling method for TGNNs optimized for accuracy, efficiency, and scalability. TASER adapts its mini-batch selection based on training dynamics and temporal neighbor selection based on the contextual, structural, and temporal properties of past interactions. To alleviate the bottleneck in mini-batch generation, TASER implements a pure GPU-based temporal neighbor finder and a dedicated GPU feature cache. We evaluate the performance of TASER using two state-of-the-art backbone TGNNs. On five popular datasets, TASER outperforms the corresponding baselines by an average of 2.3% in Mean Reciprocal Rank (MRR) while achieving an average of 5.1x speedup in training time.


title: NLO QCD corrections to the $B_c$-pair hadroproduction

abstract: The $B_c$ meson pair, including pairs of pseudoscalar states and vector states, productions in proton-proton collisions are investigated at the next-to-leading order (NLO) accuracy in the nonrelativistic quantum chromodynamics factorization formalism. The corresponding cross sections at the Large Hadron Collider (LHC) with $\sqrt{s}=14\; \text{TeV}$ are evaluated. Numerical results indicate that the NLO corrections are substantial, and even dominate over the leading order contributions. Considering the predicted cross sections are sizable, the $B_c$-pair production is expected to be observable at the High-Luminosity LHC experiment.


title: On the Effect of Image Resolution on Semantic Segmentation

abstract: High-resolution semantic segmentation requires substantial computational resources. Traditional approaches in the field typically downscale the input images before processing and then upscale the low-resolution outputs back to their original dimensions. While this strategy effectively identifies broad regions, it often misses finer details. In this study, we demonstrate that a streamlined model capable of directly producing high-resolution segmentations can match the performance of more complex systems that generate lower-resolution results. By simplifying the network architecture, we enable the processing of images at their native resolution. Our approach leverages a bottom-up information propagation technique across various scales, which we have empirically shown to enhance segmentation accuracy. We have rigorously tested our method using leading-edge semantic segmentation datasets. Specifically, for the Cityscapes dataset, we further boost accuracy by applying the Noisy Student Training technique.


title: CURE: Simulation-Augmented Auto-Tuning in Robotics

abstract: Robotic systems are typically composed of various subsystems, such as localization and navigation, each encompassing numerous configurable components (e.g., selecting different planning algorithms). Once an algorithm has been selected for a component, its associated configuration options must be set to the appropriate values. Configuration options across the system stack interact non-trivially. Finding optimal configurations for highly configurable robots to achieve desired performance poses a significant challenge due to the interactions between configuration options across software and hardware that result in an exponentially large and complex configuration space. These challenges are further compounded by the need for transferability between different environments and robotic platforms. Data efficient optimization algorithms (e.g., Bayesian optimization) have been increasingly employed to automate the tuning of configurable parameters in cyber-physical systems. However, such optimization algorithms converge at later stages, often after exhausting the allocated budget (e.g., optimization steps, allotted time) and lacking transferability. This paper proposes CURE -- a method that identifies causally relevant configuration options, enabling the optimization process to operate in a reduced search space, thereby enabling faster optimization of robot performance. CURE abstracts the causal relationships between various configuration options and robot performance objectives by learning a causal model in the source (a low-cost environment such as the Gazebo simulator) and applying the learned knowledge to perform optimization in the target (e.g., Turtlebot 3 physical robot). We demonstrate the effectiveness and transferability of CURE by conducting experiments that involve varying degrees of deployment changes in both physical robots and simulation.


title: Optimizing for ROC Curves on Class-Imbalanced Data by Training over a Family of Loss Functions

abstract: Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training under imbalance by modifying the loss functions or optimization methods. While this work has led to significant improvements in the overall accuracy in the multi-class case, we observe that slight changes in hyperparameter values of these methods can result in highly variable performance in terms of Receiver Operating Characteristic (ROC) curves on binary problems with severe imbalance. To reduce the sensitivity to hyperparameter choices and train more general models, we propose training over a family of loss functions, instead of a single loss function. We develop a method for applying Loss Conditional Training (LCT) to an imbalanced classification problem. Extensive experiment results, on both CIFAR and Kaggle competition datasets, show that our method improves model performance and is more robust to hyperparameter choices. Code is available at https://github.com/klieberman/roc_lct.


title: Adaptive Activation Functions for Predictive Modeling with Sparse Experimental Data

abstract: A pivotal aspect in the design of neural networks lies in selecting activation functions, crucial for introducing nonlinear structures that capture intricate input-output patterns. While the effectiveness of adaptive or trainable activation functions has been studied in domains with ample data, like image classification problems, significant gaps persist in understanding their influence on classification accuracy and predictive uncertainty in settings characterized by limited data availability. This research aims to address these gaps by investigating the use of two types of adaptive activation functions. These functions incorporate shared and individual trainable parameters per hidden layer and are examined in three testbeds derived from additive manufacturing problems containing fewer than one hundred training instances. Our investigation reveals that adaptive activation functions, such as Exponential Linear Unit (ELU) and Softplus, with individual trainable parameters, result in accurate and confident prediction models that outperform fixed-shape activation functions and the less flexible method of using identical trainable activation functions in a hidden layer. Therefore, this work presents an elegant way of facilitating the design of adaptive neural networks in scientific and engineering problems.


title: A State-of-the-art Survey on Full-duplex Network Design

abstract: Full-duplex (FD) technology is gaining popularity for integration into a wide range of wireless networks due to its demonstrated potential in recent studies. In contrast to half-duplex (HD) technology, the implementation of FD in networks necessitates considering inter-node interference (INI) from various network perspectives. When deploying FD technology in networks, several critical factors must be taken into account. These include self-interference (SI) and the requisite SI cancellation (SIC) processes, as well as the selection of multiple user equipment (UE) per time slot. Additionally, inter-node interference (INI), including cross-link interference (CLI) and inter-cell interference (ICI), become crucial issues during concurrent uplink (UL) and downlink (DL) transmission and reception, similar to SI. Since most INI is challenging to eliminate, a comprehensive investigation that covers radio resource control (RRC), medium access control (MAC), and the physical layer (PHY) is essential in the context of FD network design, rather than focusing on individual network layers and types. This paper covers state-of-the-art studies, including protocols and documents from 3GPP for FD, MAC protocol, user scheduling, and CLI handling. The methods are also compared through a network-level system simulation based on 3D ray-tracing.


title: In-Context Principle Learning from Mistakes

abstract: In-context learning (ICL, also known as few-shot prompting) has been the standard method of adapting LLMs to downstream tasks, by learning from a few input-output examples. Nonetheless, all ICL-based approaches only learn from correct input-output pairs. In this paper, we revisit this paradigm, by learning more from the few given input-output examples. We introduce Learning Principles (LEAP): First, we intentionally induce the model to make mistakes on these few examples; then we reflect on these mistakes, and learn explicit task-specific "principles" from them, which help solve similar problems and avoid common mistakes; finally, we prompt the model to answer unseen test questions using the original few-shot examples and these learned general principles. We evaluate LEAP on a wide range of benchmarks, including multi-hop question answering (Hotpot QA), textual QA (DROP), Big-Bench Hard reasoning, and math problems (GSM8K and MATH); in all these benchmarks, LEAP improves the strongest available LLMs such as GPT-3.5-turbo, GPT-4, GPT-4 turbo and Claude-2.1. For example, LEAP improves over the standard few-shot prompting using GPT-4 by 7.5% in DROP, and by 3.3% in HotpotQA. Importantly, LEAP does not require any more input or examples than the standard few-shot prompting settings.


title: The Computation for Reversibility of Arbitrary One-dimensional Finite Cellular Automata Becomes Efficient

abstract: In this paper, we completely solve the reversibility of one-dimensional finite cellular automata (FCA). This means that we will have an efficient method to determine the reversibility of any FCA with all numbers (n) of cells. The complexity of this algorithm is independent of n. We perform calculations on two new kinds of graphs and discover that the reversibility of any FCA exhibits periodicity as n increases. We successfully provide a method to compute the reversibility sequence that encompasses the reversibility of FCA with any number of cells. Additionally, the calculations in this paper are applicable to FCA with various types of boundaries.