title: Switchable Signaling Molecules for Media Modulation: Fundamentals, Applications, and Research Directions

abstract: Although visionary applications of molecular communication (MC), such as long-term continuous health monitoring by cooperative in-body nanomachines, have been proposed, MC is still in its infancy when it comes to practical implementation. In particular, long-term experiments and applications face issues such as depletion of signaling molecules (SMs) at the transmitter (TX) and inter-symbol interference (ISI) at the receiver (RX). To overcome these practical challenges, a new class of SMs with switchable states seems to be promising for future MC applications. In this work, we provide an overview of existing switchable SMs, and classify them according to their properties. Furthermore, we highlight how switchable SMs can be utilized as information carriers for media modulation. In addition, we present theoretical and experimental results for an end-to-end MC system employing the green fluorescent protein variant "Dreiklang" (GFPD) as switchable SM. Our experimental results show, for the first time, successful information transmission in a closed-loop pipe system using media modulation. Finally, we discuss media modulation specific challenges and opportunities.


title: A new condition for $k$-Wall-Sun-Sun primes

abstract: Let $k\ge 1$ be an integer, and let $(U_n)$ be the Lucas sequence of the first kind defined by \begin{equation*}\label{Eq:Lucas} U_0=0,\quad U_1=1\quad \mbox{and} \quad U_n=kU_{n-1}+U_{n-2} \quad \mbox{ for $n\ge 2$}. \end{equation*} It is well known that $(U_n)$ is periodic modulo any integer $m\ge 2$, and we let $\pi(m)$ denote the length of this period. A prime $p$ is called a $k$-Wall-Sun-Sun prime if $\pi(p^2)=\pi(p)$. Let $f(x)\in {\mathbb Z}[x]$ be a monic polynomial of degree $N$ that is irreducible over ${\mathbb Q}$. We say $f(x)$ is monogenic if $\Theta=\{1,\theta,\theta^2,\ldots ,\theta^{N-1}\}$ is a basis for the ring of integers ${\mathbb Z}_K$ of ${\mathbb Q}(\theta)$, where $f(\theta)=0$. If $\Theta$ is not a basis for ${\mathbb Z}_K$, we say that $f(x)$ is non-monogenic. Define ${\mathcal D}:=k^2+4$ if $k\equiv 1 \pmod{2}$, and ${\mathcal D}:=(k/2)^2+1$ if $k\equiv 0 \pmod{2}$. Suppose that $k\not \equiv 0 \pmod{4}$ and that ${\mathcal D}$ is squarefree. In this article, we prove that $p$ is a $k$-Wall-Sun-Sun prime if and only if ${\mathcal F}_p(x)=x^{2p}-kx^p-1$ is non-monogenic. This result, combined with previous work, shows that ${\mathcal F}_p(x)$ is monogenic if $p$ is a prime divisor of $k^2+4$.


title: Strong Fiber from Uniaxial Fullerene Supramolecules Aligned with Carbon Nanotubes

abstract: Carbon nanotube (CNT) wires approach copper's specific conductivity and surpass carbon fiber's strength, with further improvement anticipated with greater aspect ratios and incorporation of dopants with long-range structural order. Fullerenes assemble into multitudes of process-dependent supramolecular crystals and, while initially insulating, they become marginally conductive (up to 0.05 MSm$^{-1}$) and superconductive ($T_c=18^\circ$K with K and 28$^\circ$K with Rb) after doping. These were small (100's $\mu$m long), soft (hardness comparable to indium), and typically unaligned, which hindered development of fullerene based wires. Individual fullerenes were previously incorporated into CNT fibers, although randomly without self-assembly into supramolecules. Here, a simple variation in established CNT acid extrusion creates a fiber composed of uniaxial chains of aligned fullerene supramolecules, self-assembled between aligned few-walled CNT bundles. This will provide a testbed for novel fullerene wire transport and prospects in CNT wire advancement.


title: Replicable Clustering

abstract: We design replicable algorithms in the context of statistical clustering under the recently introduced notion of replicability from Impagliazzo et al. [2022]. According to this definition, a clustering algorithm is replicable if, with high probability, its output induces the exact same partition of the sample space after two executions on different inputs drawn from the same distribution, when its internal randomness is shared across the executions. We propose such algorithms for the statistical $k$-medians, statistical $k$-means, and statistical $k$-centers problems by utilizing approximation routines for their combinatorial counterparts in a black-box manner. In particular, we demonstrate a replicable $O(1)$-approximation algorithm for statistical Euclidean $k$-medians ($k$-means) with $\operatorname{poly}(d)$ sample complexity. We also describe an $O(1)$-approximation algorithm with an additional $O(1)$-additive error for statistical Euclidean $k$-centers, albeit with $\exp(d)$ sample complexity. In addition, we provide experiments on synthetic distributions in 2D using the $k$-means++ implementation from sklearn as a black-box that validate our theoretical results.


title: Optical Transformers

abstract: The rapidly increasing size of deep-learning models has caused renewed and growing interest in alternatives to digital computers to dramatically reduce the energy cost of running state-of-the-art neural networks. Optical matrix-vector multipliers are best suited to performing computations with very large operands, which suggests that large Transformer models could be a good target for optical computing. To test this idea, we performed small-scale optical experiments with a prototype accelerator to demonstrate that Transformer operations can run on optical hardware despite noise and errors. Using simulations, validated by our experiments, we then explored the energy efficiency of optical implementations of Transformers and identified scaling laws for model performance with respect to optical energy usage. We found that the optical energy per multiply-accumulate (MAC) scales as $\frac{1}{d}$ where $d$ is the Transformer width, an asymptotic advantage over digital systems. We conclude that with well-engineered, large-scale optical hardware, it may be possible to achieve a $100 \times$ energy-efficiency advantage for running some of the largest current Transformer models, and that if both the models and the optical hardware are scaled to the quadrillion-parameter regime, optical computers could have a $>8,000\times$ energy-efficiency advantage over state-of-the-art digital-electronic processors that achieve 300 fJ/MAC. We analyzed how these results motivate and inform the construction of future optical accelerators along with optics-amenable deep-learning approaches. With assumptions about future improvements to electronics and Transformer quantization techniques (5$\times$ cheaper memory access, double the digital--analog conversion efficiency, and 4-bit precision), we estimated that optical computers' advantage against current 300-fJ/MAC digital processors could grow to $>100,000\times$.

categories: cs.ET cs.LG cs.NE physics.app-ph physics.optics


title: Ambipolar Heating of Magnetars

abstract: Magnetars, neutron stars thought to be with ultra-strong magnetic fields of $10^{14 - 15}$ G, are observed to be much hotter than ordinary pulsars with $\sim 10^{12}$ G, and additional heating sources are required. One possibility is heating by the ambipolar diffusion in the stellar core. This scenario is examined by calculating the models using the relativistic thermal evolutionary code without making the isothermal approximation. The results show that this scenario can be consistent with most of the observed magnetar temperature data.


title: Heterogeneous Social Event Detection via Hyperbolic Graph Representations

abstract: Social events reflect the dynamics of society and, here, natural disasters and emergencies receive significant attention. The timely detection of these events can provide organisations and individuals with valuable information to reduce or avoid losses. However, due to the complex heterogeneities of the content and structure of social media, existing models can only learn limited information; large amounts of semantic and structural information are ignored. In addition, due to high labour costs, it is rare for social media datasets to include high-quality labels, which also makes it challenging for models to learn information from social media. In this study, we propose two hyperbolic graph representation-based methods for detecting social events from heterogeneous social media environments. For cases where a dataset has labels, we designed a Hyperbolic Social Event Detection (HSED) model that converts complex social information into a unified social message graph. This model addresses the heterogeneity of social media, and, with this graph, the information in social media can be used to capture structural information based on the properties of hyperbolic space. For cases where the dataset is unlabelled, we designed an Unsupervised Hyperbolic Social Event Detection (UHSED). This model is based on the HSED model but includes graph contrastive learning to make it work in unlabelled scenarios. Extensive experiments demonstrate the superiority of the proposed approaches.


title: Transformed Distribution Matching for Missing Value Imputation

abstract: We study the problem of imputing missing values in a dataset, which has important applications in many domains. The key to missing value imputation is to capture the data distribution with incomplete samples and impute the missing values accordingly. In this paper, by leveraging the fact that any two batches of data with missing values come from the same data distribution, we propose to impute the missing values of two batches of samples by transforming them into a latent space through deep invertible functions and matching them distributionally. To learn the transformations and impute the missing values simultaneously, a simple and well-motivated algorithm is proposed. Our algorithm has fewer hyperparameters to fine-tune and generates high-quality imputations regardless of how missing values are generated. Extensive experiments over a large number of datasets and competing benchmark algorithms show that our method achieves state-of-the-art performance.


title: Gaussian processes at the Helm(holtz): A more fluid model for ocean currents

abstract: Given sparse observations of buoy velocities, oceanographers are interested in reconstructing ocean currents away from the buoys and identifying divergences in a current vector field. As a first and modular step, we focus on the time-stationary case - for instance, by restricting to short time periods. Since we expect current velocity to be a continuous but highly non-linear function of spatial location, Gaussian processes (GPs) offer an attractive model. But we show that applying a GP with a standard stationary kernel directly to buoy data can struggle at both current reconstruction and divergence identification, due to some physically unrealistic prior assumptions. To better reflect known physical properties of currents, we propose to instead put a standard stationary kernel on the divergence and curl-free components of a vector field obtained through a Helmholtz decomposition. We show that, because this decomposition relates to the original vector field just via mixed partial derivatives, we can still perform inference given the original data with only a small constant multiple of additional computational expense. We illustrate the benefits of our method with theory and experiments on synthetic and real ocean data.

categories: stat.ME cs.LG physics.ao-ph stat.AP stat.ML


title: Continuum energy eigenstates via the factorization method

abstract: The factorization method was introduced by Schroedinger in 1940. Its use in bound-state problems is widely known, including in supersymmetric quantum mechanics; one can create a factorization chain, which simultaneously solves a sequence of auxiliary Hamiltonians that share common eigenvalues with their adjacent Hamiltonians in the chain, except for the lowest eigenvalue. In this work, we generalize the factorization method to continuum energy eigenstates. Here, one does not generically have a factorization chain -- instead all energies are solved using a "single-shot factorization," enabled by writing the superpotential in a form that includes the logarithmic derivative of a confluent hypergeometric function. The single-shot factorization approach is an alternative to the conventional method of "deriving a differential equation and looking up its solution," but it does require some working knowledge of confluent hypergeometric functions. This can also be viewed as a method for solving the Ricatti equation needed to construct the superpotential.


title: Programmable System Call Security with eBPF

abstract: System call filtering is a widely used security mechanism for protecting a shared OS kernel against untrusted user applications. However, existing system call filtering techniques either are too expensive due to the context switch overhead imposed by userspace agents, or lack sufficient programmability to express advanced policies. Seccomp, Linux's system call filtering module, is widely used by modern container technologies, mobile apps, and system management services. Despite the adoption of the classic BPF language (cBPF), security policies in Seccomp are mostly limited to static allow lists, primarily because cBPF does not support stateful policies. Consequently, many essential security features cannot be expressed precisely and/or require kernel modifications. In this paper, we present a programmable system call filtering mechanism, which enables more advanced security policies to be expressed by leveraging the extended BPF language (eBPF). More specifically, we create a new Seccomp eBPF program type, exposing, modifying or creating new eBPF helper functions to safely manage filter state, access kernel and user state, and utilize synchronization primitives. Importantly, our system integrates with existing kernel privilege and capability mechanisms, enabling unprivileged users to install advanced filters safely. Our evaluation shows that our eBPF-based filtering can enhance existing policies (e.g., reducing the attack surface of early execution phase by up to 55.4% for temporal specialization), mitigate real-world vulnerabilities, and accelerate filters.


title: JOINTVIP: Prioritizing variables in observational study design with joint variable importance plot in R

abstract: Credible causal effect estimation requires treated subjects and controls to be otherwise similar. In observational settings, such as analysis of electronic health records, this is not guaranteed. Investigators must balance background variables so they are similar in treated and control groups. Common approaches include matching (grouping individuals into small homogeneous sets) or weighting (upweighting or downweighting individuals) to create similar profiles. However, creating identical distributions may be impossible if many variables are measured, and not all variables are of equal importance to the outcome. The joint variable importance plot (jointVIP) package to guides decisions about which variables to prioritize for adjustment by quantifying and visualizing each variable's relationship to both treatment and outcome.


title: Towards a Sustainable Internet-of-Underwater-Things based on AUVs, SWIPT, and Reinforcement Learning

abstract: Life on earth depends on healthy oceans, which supply a large percentage of the planet's oxygen, food, and energy. However, the oceans are under threat from climate change, which is devastating the marine ecosystem and the economic and social systems that depend on it. The Internet-of-underwater-things (IoUTs), a global interconnection of underwater objects, enables round-the-clock monitoring of the oceans. It provides high-resolution data for training machine learning (ML) algorithms for rapidly evaluating potential climate change solutions and speeding up decision-making. The sensors in conventional IoUTs are battery-powered, which limits their lifetime, and constitutes environmental hazards when they die. In this paper, we propose a sustainable scheme to improve the throughput and lifetime of underwater networks, enabling them to potentially operate indefinitely. The scheme is based on simultaneous wireless information and power transfer (SWIPT) from an autonomous underwater vehicle (AUV) used for data collection. We model the problem of jointly maximising throughput and harvested power as a Markov Decision Process (MDP), and develop a model-free reinforcement learning (RL) algorithm as a solution. The model's reward function incentivises the AUV to find optimal trajectories that maximise throughput and power transfer to the underwater nodes while minimising energy consumption. To the best of our knowledge, this is the first attempt at using RL to ensure sustainable underwater networks via SWIPT. The scheme is implemented in an open 3D RL environment specifically developed in MATLAB for this study. The performance results show up 207% improvement in energy efficiency compared to those of a random trajectory scheme used as a baseline model.


title: The Benefit of Uncertainty Coupling in Robust and Adaptive Robust Optimization

abstract: Despite the modeling power for problems under uncertainty, robust optimization (RO) and adaptive robust optimization (ARO) can exhibit too conservative solutions in terms of objective value degradation compared to the nominal case. One of the main reasons behind this conservatism is that, in many practical applications, uncertain constraints are directly designed as constraint-wise without taking into account couplings over multiple constraints. In this paper, we define a coupled uncertainty set as the intersection between a constraint-wise uncertainty set and a coupling set. We study the benefit of coupling in alleviating conservatism in RO and ARO. We provide theoretical tight and computable upper and lower bounds on the objective value improvement of RO and ARO problems under coupled uncertainty over constraint-wise uncertainty. In addition, we relate the power of adaptability over static solutions with the coupling of uncertainty set. Computational results demonstrate the benefit of coupling in applications.


title: Supersymmetric localization: ${\cal N}=(2,2)$ theories on S$^2$ and AdS$_2$

abstract: Application of the supersymmetric localization method to theories on anti-de Sitter spacetime has received recent interest, yet still remains as a challenging problem. In this paper, we focus on (global) Euclidean AdS$_2$, on which we consider an Abelian ${\cal N}=(2,2)$ theory and implement localization computation to obtain the exact partition function. For comparison, we also revisit the theory on S$^2$ and perform a parallel computation. We refine the notion of equivariant supersymmetry and use appropriate functional integration measure. For AdS$_2$ we choose a supersymmetric boundary condition which is compatible with the principle of variation. To evaluate the 1-loop determinant about the localization saddle, we use index theory and fixed point formula, where we pay attention to the effect of zero modes and their superpartners. The existence of fermionic superpartner of 1-form boundary zero modes is proven. Obtaining the 1-loop determinant requires expansion of the index that presents an ambiguity, which we resolve using boundary condition. The resulting partition function reveals an overall dependence on the size of the background manifold, AdS$_2$ as well as S$^2$, as a sum of two types of contributions: a local one from local conformal anomaly through the index computation and a global one coming from zero modes. This overall size dependence is confirmed by the perturbative 1-loop evaluation using heat kernel method.


title: Variance-Dependent Regret Bounds for Linear Bandits and Reinforcement Learning: Adaptivity and Computational Efficiency

abstract: Recently, several studies (Zhou et al., 2021a; Zhang et al., 2021b; Kim et al., 2021; Zhou and Gu, 2022) have provided variance-dependent regret bounds for linear contextual bandits, which interpolates the regret for the worst-case regime and the deterministic reward regime. However, these algorithms are either computationally intractable or unable to handle unknown variance of the noise. In this paper, we present a novel solution to this open problem by proposing the first computationally efficient algorithm for linear bandits with heteroscedastic noise. Our algorithm is adaptive to the unknown variance of noise and achieves an $\tilde{O}(d \sqrt{\sum_{k = 1}^K \sigma_k^2} + d)$ regret, where $\sigma_k^2$ is the variance of the noise at the round $k$, $d$ is the dimension of the contexts and $K$ is the total number of rounds. Our results are based on an adaptive variance-aware confidence set enabled by a new Freedman-type concentration inequality for self-normalized martingales and a multi-layer structure to stratify the context vectors into different layers with different uniform upper bounds on the uncertainty. Furthermore, our approach can be extended to linear mixture Markov decision processes (MDPs) in reinforcement learning. We propose a variance-adaptive algorithm for linear mixture MDPs, which achieves a problem-dependent horizon-free regret bound that can gracefully reduce to a nearly constant regret for deterministic MDPs. Unlike existing nearly minimax optimal algorithms for linear mixture MDPs, our algorithm does not require explicit variance estimation of the transitional probabilities or the use of high-order moment estimators to attain horizon-free regret. We believe the techniques developed in this paper can have independent value for general online decision making problems.


title: Blowups and Tops of Overlapping Iterated Function Systems

abstract: We review aspects of an important paper by Robert Strichartz concerning reverse iterated function systems (i.f.s.) and fractal blowups. We compare the invariant sets of reverse i.f.s. with those of more standard i.f.s. and with those of inverse i.f.s. We describe Strichartz' fractal blowups and explain how they may be used to construct tilings of $\mathbb{R}^{n}$ even in the case where the i.f.s. is overlapping. We introduce and establish the notion of "tops" of blowups. Our motives are not pure: we seek to show that a simple i.f.s. and an idea of Strichartz, can be used to create complicated tilings that may model natural structures.


title: Beam Energy Dependence of the Linear and Mode-Coupled Flow Harmonics Using the A Multi-Phase Transport Model

abstract: In the framework of the A Multi-Phase Transport (AMPT) model, the multi-particle azimuthal cumulant method is used to calculate the linear and mode-coupled contributions to the quadrangular flow harmonic ($v_{4}$), mode-coupled response coefficient as a function of centrality in Au+Au collisions at $\sqrt{s_{\mathrm{NN}}}$ = 200, 39, 27 and 19.6 GeV. This study indicated that the linear and mode-coupled contributions to the $v_{4}$ are sensitive to the beam energy change. Nevertheless, the correlations between different order flow symmetry planes and the mode-coupled response coefficients show a weak beam energy dependence. In addition, the presented results suggest that the experimental measurements that span a broad range of beam energies can be an additional constraint for the theoretical models' calculations.


title: UV-FIR SED modeling of AGN in IR-luminous galaxies up to z~2.5: Understanding the effects of torus models

abstract: UV-FIR SED modeling is an effective way to disentangle emission between star formation (SF) and active galactic nuclei (AGN) in galaxies; however, this approach becomes uncertain for composite AGN/SF galaxies that comprise 50-70% of IR-samples. Cosmic X-ray background (XRB) models require a large fraction of obscured AGN to reproduce the observed XRB peak, motivating reliable SED analyses in objects where the AGN may be ``buried" in the galaxy and in the mid-IR to far-IR SED. In this paper, we study a 24$\mu$m-selected ($S_{24}$ > 100$\mu$Jy) sample of 95 galaxies with $0 \% < f_{MIR,AGN} < 100 \%$, 0.4 < z < 2.7, and $10^{11}$L$_{\odot}$ < L$_{IR}$ < $10^{13}$L$_{\odot}$. We test the performance of AGN models ranging in torus optical depth via SED fitting, comparing results with Spitzer MIR spectroscopy and X-ray observations. Best-fit torus optical depth can shed light on whether these galaxies host a luminous obscured AGN population. We find that permitting a broader AGN SED parameter space results in improved fit quality with higher optical depths, higher FIR AGN contributions, and higher $L_{Bol}$, impacting the bright-end of the $L_{Bol}$ luminosity function. Our results suggest there may be a population of dust-obscured composites that are bolometrically significant but have their AGN mostly hidden in the mid-IR SED. If so, literature applications of SED fitting that often simplify AGN models or omit optically thick tori may largely underestimate AGN contribution from composite sources, as these sources are both numerous and have solutions sensitive to the assumed range of AGN models.


title: Cultural transmission of move choice in chess

abstract: The study of cultural evolution benefits from detailed analysis of cultural transmission in specific human domains. Chess provides a platform for understanding the transmission of knowledge due to its active community of players, precise behaviors, and long-term records of high-quality data. In this paper, we perform an analysis of chess in the context of cultural evolution, describing multiple cultural factors that affect move choice. We then build a population-level statistical model of move choice in chess, based on the Dirichlet-multinomial likelihood, to analyze cultural transmission over decades of recorded games played by leading players. For moves made in specific positions, we evaluate the relative effects of frequency-dependent bias, success bias, and prestige bias on the dynamics of move frequencies. We observe that negative frequency-dependent bias plays a role in the dynamics of certain moves, and that other moves are compatible with transmission under prestige bias or success bias. These apparent biases may reflect recent changes, namely the introduction of computer chess engines and online tournament broadcasts. Our analysis of chess provides insights into broader questions concerning how social learning biases affect cultural evolution.


title: Reconstructing the XUV Spectra of Active Sun-like Stars Using Solar Scaling Relations with Magnetic Flux

abstract: Kepler Space Telescope and Transiting Exoplanet Survey Satellite unveiled that Sun-like stars frequently host exoplanets. These exoplanets are subject to fluxes of ionizing radiation in the form of X-ray and extreme-ultraviolet (EUV) radiation that may cause changes in their atmospheric dynamics and chemistry. While X-ray fluxes can be observed directly, EUV fluxes cannot be observed because of severe interstellar medium absorption. Here, we present a new empirical method to estimate the whole stellar XUV (X-ray plus EUV) and FUV spectra as a function of total unsigned magnetic fluxes of stars. The response of the solar XUV and FUV spectrum (0.1-180 nm) to the solar total unsigned magnetic flux is investigated by using the long-term Sun-as-a-star dataset over 10 yrs, and the power-law relation is obtained for each wavelength with a spectral resolution of 0.1-1 nm. We applied the scaling relations to active young Sun-like stars (G-dwarfs), EK Dra (G1.5V), $\pi^1$ Uma (G1.5V) and $\kappa^1$ Ceti (G5V), and found that the observed spectra (except for the unobservable longward EUV wavelength) are roughly consistent with the extension of the derived power-law relations with errors of an order of magnitude. This suggests that our model is a valuable method to derive the XUV/FUV fluxes of Sun-like stars including the EUV band mostly absorbed at wavelengths longward of 36 nm. We also discuss differences between the solar extensions and stellar observations at the wavelength in the 2-30 nm band and concluded that simultaneous observations of magnetic and XUV/FUV fluxes are necessary for further validations.


title: Real-time speech enhancement with dynamic attention span

abstract: For real-time speech enhancement (SE) including noise suppression, dereverberation and acoustic echo cancellation, the time-variance of the audio signals becomes a severe challenge. The causality and memory usage limit that only the historical information can be used for the system to capture the time-variant characteristics. We propose to adaptively change the receptive field according to the input signal in deep neural network based SE model. Specifically, in an encoder-decoder framework, a dynamic attention span mechanism is introduced to all the attention modules for controlling the size of historical content used for processing the current frame. Experimental results verify that this dynamic mechanism can better track time-variant factors and capture speech-related characteristics, benefiting to both interference removing and speech quality retaining.


title: The Baker-Schmidt problem for dual approximation and some classes of functions

abstract: The Generalised Baker-Schmidt Problem (1970) concerns the Hausdorff $f$-measure of the set of $\Psi$-approximable points on a nondegenerate manifold. We refine and extend our previous work [Int. Math. Res. Not. IMRN 2021, no. 12, 8845--8867] in which we settled the problem (for dual approximation) for hypersurfaces. We verify the GBSP for certain classes of nondegenerate submanifolds of codimension greater than $1$. Concretely, for codimension two or three, we provide examples of manifolds where the dependent variables can be chosen as quadratic forms. Our method requires the manifold to have even dimension at least the minimum of four and half the dimension of the ambient space. We conjecture that these restrictions on the dimension of the manifold are sufficient to provide similar examples in general.


title: An exponentially shrinking problem

abstract: The Jarn\'ik-Besicovitch theorem is a fundamental result in metric number theory which gives the Hausdorff dimension for limsup sets. We investigate a related problem of estimating the Hausdorff dimension of a liminf set. Let $h>0, \tau\geq 1$, and for any $j\geq 1$ define the integer sequence $q_{j+1}=q_j^h$. We prove the Hausdorff dimension of the set $$\Lambda^\bftheta_d(\tau)=\left\{\xx\in[0, 1)^d: \|q_jx_i-\theta_i\|<q_j^{-\tau} \ \text{for all } j\geq 1, i=1,2,\cdots,d\right\},$$ where $\left\|\star\right\|$ denotes the distance to the nearest integer and $\bftheta\in [0, 1)^d$ is fixed. We also give some heuristics for the Hausdorff dimension of the corresponding multiplicative set $$\MM_d^\bftheta(\tau)=\left\{\xx\in[0, 1)^d:\prod_{i=1}^d \|q_jx_i-\theta_i\|<q_j^{-\tau} \ \text{for all } j\geq 1\right\}.$$


title: Hydrodynamic irreversibility of non-Brownian suspensions in highly confined duct flow

abstract: The irreversible behavior of a highly confined non-Brownian suspension of spherical particles at low Reynolds number in a Newtonian fluid is studied experimentally and numerically. In experiment, the suspension is confined in a thin rectangular channel that prevents complete particle overlap in the narrow dimension and subjected to an oscillatory pressure-driven flow. In the small cross-sectional dimension particles rapidly separate to the walls, whereas in the large dimension features reminiscent of shear-induced migration in bulk suspensions are recovered. Furthermore, as a consequence of the channel geometry and the development and application of a single-camera particle tracking method, three-dimensional particle trajectories are obtained that allow us to directly associate relative particle proximity with the observed migration. Companion simulations of a steadily flowing suspension highly confined between parallel plates are conducted using the Force Coupling Method which also show rapid migration to the walls as well as other salient features observed in the experiment. While we consider relatively low volume fractions compared to most prior work in the area, we nevertheless observe significant and rapid migration which we attribute to the high degree of confinement.


title: Electronic Laboratory Notebook on Web2py Framework

abstract: Proper experimental record-keeping is an important cornerstone in research and development for the purpose of auditing. The gold standard of record-keeping is based on the judicious use of physical, permanent notebooks. However, advances in technology had resulted in large amounts of electronic records making it virtually impossible to maintain a full set of records in physical notebooks. Electronic laboratory notebook systems aim to meet the stringency for keeping records electronically. This manuscript describes CyNote which is an electronic laboratory notebook system that is compliant with 21 CFP Part 11 controls on electronic records, requirements set by USA Food and Drug Administration for electronic records. CyNote is implemented on web2py framework and is adhering to the architectural paradigm of model-view-controller (MVC), allowing for extension modules to be built for CyNote. CyNote is available at http://cynote.sf.net.


title: Constrained Reinforcement Learning for Predictive Control in Real-Time Stochastic Dynamic Optimal Power Flow

abstract: Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the reward function. However, this approach can lead to infeasible solutions that violate physical constraints such as power flow equations, voltage limits, and dynamic constraints. Ensuring these constraints are met is crucial in power systems, as they are a safety critical infrastructure. To address this issue, existing DRL algorithms remedy the problem by projecting the actions onto the feasible set, which can result in sub-optimal solutions. This paper presents a novel primal-dual approach for learning optimal constrained DRL policies for dynamic optimal power flow problems, with the aim of controlling power generations and battery outputs. We also prove the convergence of the critic and actor networks. Our case studies on IEEE standard systems demonstrate the superiority of the proposed approach in dynamically adapting to the environment while maintaining safety constraints.


title: On Interpretable Approaches to Cluster, Classify and Represent Multi-Subspace Data via Minimum Lossy Coding Length based on Rate-Distortion Theory

abstract: To cluster, classify and represent are three fundamental objectives of learning from high-dimensional data with intrinsic structure. To this end, this paper introduces three interpretable approaches, i.e., segmentation (clustering) via the Minimum Lossy Coding Length criterion, classification via the Minimum Incremental Coding Length criterion and representation via the Maximal Coding Rate Reduction criterion. These are derived based on the lossy data coding and compression framework from the principle of rate distortion in information theory. These algorithms are particularly suitable for dealing with finite-sample data (allowed to be sparse or almost degenerate) of mixed Gaussian distributions or subspaces. The theoretical value and attractive features of these methods are summarized by comparison with other learning methods or evaluation criteria. This summary note aims to provide a theoretical guide to researchers (also engineers) interested in understanding 'white-box' machine (deep) learning methods.


title: Long time solutions of quasilinear Klein-Gordon equations with small weakly decaying initial data

abstract: It is well known that for the quasilinear Klein-Gordon equation with quadratic nonlinearity and sufficiently decaying small initial data, there exists a global smooth solution if the space dimensions $d\geq2$. When the initial data are of size $\varepsilon>0$ in the Sobolev space, for the semilinear Klein-Gordon equation satisfying the null condition, the authors in the article (J.-M. Delort, Daoyuan Fang, Almost global existence for solutions of semilinear Klein-Gordon equations with small weakly decaying Cauchy data, Comm. Partial Differential Equations 25 (2000), no. 11-12, 2119--2169) prove that the solution exists in time $[0,T_\varepsilon)$ with $T_\varepsilon\ge Ce^{C\varepsilon^{-\mu}}$ ($\mu=1$ if $d\ge3$, $\mu=2/3$ if $d=2$). In the present paper, we will focus on the general quasilinear Klein-Gordon equation without the null condition and further show that the existence time of the solution can be improved to $T_\varepsilon=+\infty$ if $d\geq3$ and $T_\varepsilon\ge e^{C\varepsilon^{-2}}$ if $d=2$. In addition, for $d=2$ and any fixed number $\alpha>0$, if the weighted $L^2$ norm of the initial data with the weight $(1+|x|)^\alpha$ is small, then the solution exists globally and scatters to a free solution. The arguments are based on the introduction of a good unknown, the Strichartz estimate, the weighted $L^2$-norm estimate and the resonance analysis.


title: The partial null conditions and global smooth solutions of the nonlinear wave equations on $\mathbb{R}^d\times\mathbb{T}$ with $d=2,3$

abstract: In this paper, we investigate the fully nonlinear wave equations on the product space $\mathbb{R}^3\times\mathbb{T}$ with quadratic nonlinearities and on $\mathbb{R}^2\times\mathbb{T}$ with cubic nonlinearities, respectively. It is shown that for the small initial data satisfying some space-decay rates at infinity, these nonlinear equations admit global smooth solutions when the corresponding partial null conditions hold and while have almost global smooth solutions when the partial null conditions are violated. Our proof relies on the Fourier mode decomposition of the solutions with respect to the periodic direction, the efficient combinations of time-decay estimates for the solutions to the linear wave equations and the linear Klein-Gordon equations, and the global weighted energy estimates. In addition, an interesting auxiliary energy is introduced. As a byproduct, our results can be applied to the 4D irrotational compressible Euler equations of polytropic gases or Chaplygin gases on $\mathbb{R}^3\times\mathbb{T}$, the 3D relativistic membrane equation and the 3D nonlinear membrane equation on $\mathbb{R}^2\times\mathbb{T}$.


title: Controlling dark solitons on the healing length scale

abstract: While usually the optical diffraction limit is setting a limit for the lengthscales on which a typical alkali Bose-Einstein condensate can be controlled, we show that in certain situations control via matter waves can achieve smaller resolutions. For this we consider a small number of impurity atoms which are trapped inside the density dip of a dark soliton state and show that any grey soliton can be obtained by just driving the impurity atoms. By controlling the driving force on the impurity, one can therefore fully control the position and velocity of the dark soliton, and also study controlled collisions between these non-linear objects.


title: Hypergeometry and the AGM over Finite Fields

abstract: One of the most celebrated applications of Gauss' $_2F_1$ hypergeometric functions is in connection with the rapid convergence of sequences and special values that arise in the theory of arithmetic and geometric means. This theory was the inspiration for a recent paper \cite{jelly1} in which a finite field analogue of AGM$_\mathbb{R}$ was defined and then studied using finite field hypergeometric functions. Instead of convergent sequences, one gets directed graphs that combine to form disjoint unions of graphs that individually resemble "jellyfish". Echoing the connection of hypergeometric functions to periods of elliptic curves, these graphs organize elliptic curves over finite fields. Here we use such "jellyfish swarms" to prove new identities for Gauss' class numbers of positive definite binary quadratic forms. Moreover, we prove that the sizes of jellyfish are in part dictated by the order of the prime above 2 in certain class groups.


title: Efficient Computation of Power System Maximum Transient Linear Growth

abstract: Existing methods to determine the stability of a power system to small perturbations are based on eigenvalue analysis and focus on the asymptotic (long-term) behavior of the power grid. During the preasymptotic (short-term) transient, however, the system can exhibit large growth that is not explained by eigenvalues alone. In this paper we propose a new framework to determine the maximum (optimal) preasymptotic growth using the singular value decomposition. The approach is tailored to the analysis of quantities of interest in power system dynamics, such as the set of rotor speed deviations. Matrix-free techniques are developed to avoid the explicit formation of dense matrices and enable the analysis of large-scale systems without reaching memory bounds. Extensive results carried out from small to very large-scale systems (e.g., 70k-bus system) verify the theoretical aspects of the technique.


title: Bayesian Inference for Evidence Accumulation Models with Regressors

abstract: Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become important both in basic scientific applications and solution-focussed applied work. Hierarchical Bayesian estimation frameworks for the linear ballistic accumulator model (LBA) and the diffusion decision model (DDM) have been widely used, but still suffer from some key limitations, particularly for large sample sizes, for models with many parameters, and when linking decision-relevant covariates to model parameters. We extend upon previous work with methods for estimating the LBA and DDM in hierarchical Bayesian frameworks that include random effects which are correlated between people, and include regression-model links between decision-relevant covariates and model parameters. Our methods work equally well in cases where the covariates are measured once per person (e.g., personality traits or psychological tests) or once per decision (e.g., neural or physiological data). We provide methods for exact Bayesian inference, using particle-based MCMC, and also approximate methods based on variational Bayesian (VB) inference. The VB methods are sufficiently fast and efficient that they can address large-scale estimation problems, such as with very large data sets. We evaluate the performance of these methods in applications to data from three existing experiments. Detailed algorithmic implementations and code are freely available for all methods.


title: DrasCLR: A Self-supervised Framework of Learning Disease-related and Anatomy-specific Representation for 3D Medical Images

abstract: Large-scale volumetric medical images with annotation are rare, costly, and time prohibitive to acquire. Self-supervised learning (SSL) offers a promising pre-training and feature extraction solution for many downstream tasks, as it only uses unlabeled data. Recently, SSL methods based on instance discrimination have gained popularity in the medical imaging domain. However, SSL pre-trained encoders may use many clues in the image to discriminate an instance that are not necessarily disease-related. Moreover, pathological patterns are often subtle and heterogeneous, requiring the ability of the desired method to represent anatomy-specific features that are sensitive to abnormal changes in different body parts. In this work, we present a novel SSL framework, named DrasCLR, for 3D medical imaging to overcome these challenges. We propose two domain-specific contrastive learning strategies: one aims to capture subtle disease patterns inside a local anatomical region, and the other aims to represent severe disease patterns that span larger regions. We formulate the encoder using conditional hyper-parameterized network, in which the parameters are dependant on the anatomical location, to extract anatomically sensitive features. Extensive experiments on large-scale computer tomography (CT) datasets of lung images show that our method improves the performance of many downstream prediction and segmentation tasks. The patient-level representation improves the performance of the patient survival prediction task. We show how our method can detect emphysema subtypes via dense prediction. We demonstrate that fine-tuning the pre-trained model can significantly reduce annotation efforts without sacrificing emphysema detection accuracy. Our ablation study highlights the importance of incorporating anatomical context into the SSL framework.


title: Low-Complexity Three-Dimensional AOA-Cross Geometric Center Localization Methods via Multi-UAV network

abstract: Angle of arrival (AOA) is widely used to locate a wireless signal emitter in unmanned aerial vehicle (UAV) localization. Compared with received signal strength (RSS) and time of arrival (TOA), it has higher accuracy and is not sensitive to time synchronization of the distributed sensors. However, there are few works focused on three-dimensional (3-D) scenario. Furthermore, although maximum likelihood estimator (MLE) has a relatively high performance, its computational complexity is ultra high. It is hard to employ it in practical applications. This paper proposed two multiplane geometric center based methods for 3-D AOA in UAV positioning. The first method could estimate the source position and angle measurement noise at the same time by seeking a center of the inscribed sphere, called CIS. Firstly, every sensor could measure two angles, azimuth angle and elevation angle. Based on that, two planes are constructed. Then, the estimated values of source position and angle noise are achieved by seeking the center and radius of the corresponding inscribed sphere. Deleting the estimation of the radius, the second algorithm, called MSD-LS, is born. It is not able to estimate angle noise but has lower computational complexity. Theoretical analysis and simulation results show that proposed methods could approach the Cramer-Rao lower bound (CRLB) and have lower complexity than MLE.


title: From seeing to remembering: Images with harder-to-reconstruct representations leave stronger memory traces

abstract: Much of what we remember is not due to intentional selection, but simply a by-product of perceiving. This raises a foundational question about the architecture of the mind: How does perception interface with and influence memory? Here, inspired by a classic proposal relating perceptual processing to memory durability, the level-of-processing theory, we present a sparse coding model for compressing feature embeddings of images, and show that the reconstruction residuals from this model predict how well images are encoded into memory. In an open memorability dataset of scene images, we show that reconstruction error not only explains memory accuracy but also response latencies during retrieval, subsuming, in the latter case, all of the variance explained by powerful vision-only models. We also confirm a prediction of this account with 'model-driven psychophysics'. This work establishes reconstruction error as a novel signal interfacing perception and memory, possibly through adaptive modulation of perceptual processing.


title: Epistemic Prediction and Planning with Implicit Coordination for Multi-Robot Teams in Communication Restricted Environments

abstract: In communication restricted environments, a multi-robot system can be deployed to either: i) maintain constant communication but potentially sacrifice operational efficiency due to proximity constraints or ii) allow disconnections to increase environmental coverage efficiency, challenges on how, when, and where to reconnect (rendezvous problem). In this work we tackle the latter problem and notice that most state-of-the-art methods assume that robots will be able to execute a predetermined plan; however system failures and changes in environmental conditions can cause the robots to deviate from the plan with cascading effects across the multi-robot system. This paper proposes a coordinated epistemic prediction and planning framework to achieve consensus without communicating for exploration and coverage, task discovery and completion, and rendezvous applications. Dynamic epistemic logic is the principal component implemented to allow robots to propagate belief states and empathize with other agents. Propagation of belief states and subsequent coverage of the environment is achieved via a frontier-based method within an artificial physics-based framework. The proposed framework is validated with both simulations and experiments with unmanned ground vehicles in various cluttered environments.


title: The generalized anisotropic dynamical Wentzell heat equation with nonstandard growth conditions

abstract: The aim of this paper is to establish the solvability and global regularity theory for a new class of generalized anisotropic heat-type boundary value problems with (pure) dynamical anisotropic Wentzell boundary conditions. We first prove that the Wentzell operator with the above boundary conditions generates a nonlinear order-preserving submarkovian C_0-semigroup \{T_{\sigma}(t)\} over \mathbb{X\!}^{\,r(\cdot)}(\overline{\Omega}):=L^{r(\cdot)}(\Omega)\times L^{r(\cdot)}(\Gamma) for all measurable functions r(\cdot) on \overline{\Omega} with 1\leq r^-\leq r^+<\infty. Consequently, the corresponding anisotropic dynamical Wentzell problem is well-posed over \mathbb{X\!}^{\,r(\cdot)}(\overline{\Omega}). Furthermore, we show that the nonlinear C_0-semigroup \{T_{\sigma}(t)\} enjoys a H\"older-type ultracontractivity property in the sense that there exist constants C_1,\,C_2,\,\kappa>0, and \gamma\in(0,1), such that |\|T_{\sigma}(t)\mathbf{u}_0-T_{\sigma}(t)\mathbf{v}_0\||_{_{\infty}}\,\leq\, C_1\,e^{C_2t}t^{-\kappa}|\|\mathbf{u}_0-\mathbf{v}_0\||^{\gamma}_{_{r(\cdot),s(\cdot)}} for every \mathbf{u}_0,\,\mathbf{v}_0\in\mathbb{X\!}^{\,r(\cdot),s(\cdot)}(\overline{\Omega}) and for all t>0.


title: Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience

abstract: Despite the widespread use of artificial intelligence (AI), designing user experiences (UX) for AI-powered systems remains challenging. UX designers face hurdles understanding AI technologies, such as pre-trained language models, as design materials. This limits their ability to ideate and make decisions about whether, where, and how to use AI. To address this problem, we bridge the literature on AI design and AI transparency to explore whether and how frameworks for transparent model reporting can support design ideation with pre-trained models. By interviewing 23 UX practitioners, we find that practitioners frequently work with pre-trained models, but lack support for UX-led ideation. Through a scenario-based design task, we identify common goals that designers seek model understanding for and pinpoint their model transparency information needs. Our study highlights the pivotal role that UX designers can play in Responsible AI and calls for supporting their understanding of AI limitations through model transparency and interrogation.


title: Assessing Domain Gap for Continual Domain Adaptation in Object Detection

abstract: To ensure reliable object detection in autonomous systems, the detector must be able to adapt to changes in appearance caused by environmental factors such as time of day, weather, and seasons. Continually adapting the detector to incorporate these changes is a promising solution, but it can be computationally costly. Our proposed approach is to selectively adapt the detector only when necessary, using new data that does not have the same distribution as the current training data. To this end, we investigate three popular metrics for domain gap evaluation and find that there is a correlation between the domain gap and detection accuracy. Therefore, we apply the domain gap as a criterion to decide when to adapt the detector. Our experiments show that our approach has the potential to improve the efficiency of the detector's operation in real-world scenarios, where environmental conditions change in a cyclical manner, without sacrificing the overall performance of the detector. Our code is publicly available at https://github.com/dadung/DGE-CDA.


title: Characterising SMSS J2157--3602, the most luminous known quasar, with accretion disc models

abstract: We develop an accretion disc (AD) fitting method, utilising thin and slim disc models and Bayesian inference with the Markov-Chain Monte-Carlo approach, testing it on the most luminous known quasar, SMSS J215728.21-360215.1, at redshift $z=4.692$. With a spectral energy distribution constructed from near-infrared spectra and broadband photometry, the AD models find a black hole mass of $\log(M_{\rm{AD}}/M_{\odot}) = 10.31^{+0.17}_{-0.14}$ with an anisotropy-corrected bolometric luminosity of $\log{(L_{\rm{bol}}/\rm{erg\,s^{-1}})} = 47.87 \pm 0.10$, and derive an Eddington ratio of $0.29^{+0.11}_{-0.10}$ as well as a radiative efficiency of $0.09^{+0.05}_{-0.03}$. Using the near-infrared spectra, we estimate the single-epoch virial black hole mass estimate to be $\log(M_{\rm{SE}}/M_{\odot}) = 10.33 \pm 0.08$, with a monochromatic luminosity at 3000\AA\ of $\log{(L(\rm{3000\text{\AA}})/\rm{erg\,s^{-1}})} = 47.66 \pm 0.01$. As an independent approach, AD fitting has the potential to complement the single-epoch virial mass method in obtaining stronger constraints on properties of massive quasar black holes across a wide range of redshifts.


title: A learned conservative semi-Lagrangian finite volume scheme for transport simulations

abstract: Semi-Lagrangian (SL) schemes are known as a major numerical tool for solving transport equations with many advantages and have been widely deployed in the fields of computational fluid dynamics, plasma physics modeling, numerical weather prediction, among others. In this work, we develop a novel machine learning-assisted approach to accelerate the conventional SL finite volume (FV) schemes. The proposed scheme avoids the expensive tracking of upstream cells but attempts to learn the SL discretization from the data by incorporating specific inductive biases in the neural network, significantly simplifying the algorithm implementation and leading to improved efficiency. In addition, the method delivers sharp shock transitions and a level of accuracy that would typically require a much finer grid with traditional transport solvers. Numerical tests demonstrate the effectiveness and efficiency of the proposed method.


title: Predicting the Early Stages of Solid-State Precipitation in Al-rich Al-Pt Alloys

abstract: The high strength of structural aluminium alloys depends strongly on the controlled precipitation of specific intermetallic phases, whose identity and crystal structure can be difficult to predict. Here, we investigate the Al-Pt system, which shows some similarity to the Al-Cu system as one of their main intermetallic phases, $Al_2Pt$, is nearly isostructural with $\theta^{\prime} (Al_2Cu)$, the metastable phase responsible for the high-strength of Al-Cu alloys. However, phases in Al-Pt alloys are complex and have not been studied in detail. Using a combination of density-functional theory (DFT) calculations and classical nucleation theory (CNT) applied to the Al-Pt system, we design a workflow to predict the thermodynamics of solid solution, intermediate phases such as GP zones, stable and metastable precipitates, and their precipitation sequence. This workflow can be applied to an arbitrary binary alloying system. We confirm the known stable phases $Al_4Pt$, $Al_{21}Pt_8$, $Al_2Pt$, $Al_3Pt_2$, $AlPt (\alpha \& \beta)$, $Al_3Pt_5$, $AlPt_2 (\alpha \& \beta)$ and $AlPt_3 (\alpha \& \beta)$. We also reveal the possible existence of two phases of chemical formulae $Al_5Pt$ and $Al_3Pt$. This large number of intermetallic phases is due to the strong bonding between Al and Pt, which also leads to significant favourable Pt solute formation energy in the Al matrix. Our findings are compared with the known precipitation characteristics of the binary Al-Cu and Al-Au systems. We find that the $\theta^{\prime}$-like $Al_2Pt$ precipitate phase has a lower coherent interfacial energy than $\theta^{\prime}$. Our calculations strongly suggest that $Al_2Pt$ will precipitate first in Al-rich Al-Pt alloys and will form bulk-like interfaces similar to $\eta (Al_2Au)$ rather than like $\theta^{\prime}(Al_2Cu)$.


title: An Efficient Two-stage Gradient Boosting Framework for Short-term Traffic State Estimation

abstract: Real-time traffic state estimation is essential for intelligent transportation systems. The NeurIPS 2022 Traffic4cast challenge provides an excellent testbed for benchmarking short-term traffic state estimation approaches. This technical report describes our solution to this challenge. In particular, we present an efficient two-stage gradient boosting framework for short-term traffic state estimation. The first stage derives the month, day of the week, and time slot index based on the sparse loop counter data, and the second stage predicts the future traffic states based on the sparse loop counter data and the derived month, day of the week, and time slot index. Experimental results demonstrate that our two-stage gradient boosting framework achieves strong empirical performance, achieving third place in both the core and the extended challenges while remaining highly efficient. The source code for this technical report is available at \url{https://github.com/YichaoLu/Traffic4cast2022}.


title: Extensional rheometry of mobile fluids. Part I: OUBER, an optimized uniaxial and biaxial extensional rheometer

abstract: We present a numerical optimization of a "6-arm cross-slot" device, yielding several three-dimensional shapes of fluidic channels designed to impose close approximations to ideal uniaxial (or biaxial) stagnation point extensional flow under the constraints of having four inlets and two outlets (or two inlets and four outlets) and Newtonian creeping flow conditions. Of the various numerically-generated geometries, one is selected as being most suitable for fabrication at the microscale, and numerical simulations with the Oldroyd-B and Phan-Thien and Tanner models confirm that the optimal flow fields in the chosen geometry are observed for both constant viscosity and shear thinning viscoelastic fluids. Fabrication of the geometry, which we name the optimized uniaxial and biaxial extensional rheometer (OUBER), is achieved with high precision at the microscale by selective laser-induced etching of a fused-silica substrate. Employing a viscous Newtonian fluid with a refractive index matched to that of the optically transparent microfluidic device, we conduct microtomographic-particle image velocimetry in order to resolve the flow field at low Reynolds number (< 0.1) in a substantial volume around the stagnation point. The flow velocimetry confirms the accurate imposition of the desired and predicted flows, with pure extensional flow at an essentially uniform deformation rate being applied over a wide region around the stagnation point. In Part II of this paper [Haward et al., J. Rheol. submitted (2023)], pressure drop measurements in the OUBER geometry will be used to assess the uniaxial and biaxial extensional rheometry of dilute polymeric solutions, in comparison to measurements made in planar extension using an optimized-shape cross-slot extensional rheometer (OSCER, Haward et al, Phys. Rev. Lett., 2012).


title: Democratizing Making: Scaffolding Participation Using e-Waste to Engage Under-resourced Communities in Technology Design

abstract: Maker culture and DIY practices are central to democratizing the design of technology; enabling non-designers (future end-users) to actively participate in the design process. However, little is known about how individuals from under-resourced communities and low socioeconomic status (SES) backgrounds, can practically leverage maker practices to design technology, creating value for themselves or their communities. To investigate this, we collaborated with an e-waste recycling centre, involving 24 participants (staff and low-SES volunteers) in two participatory maker workshop activities. Participants were provided with a generative e-waste toolkit, through which they repurposed e-waste materials and developed novel technology prototypes that created value from their perspectives and agendas. Our findings unpack three factors that influenced their making: balancing personal and community needs; incorporating convenience and productivity; and re-thinking sustainability and connection; and discuss strategies for scaffolding participation and engagement of under-resourced communities in making using an e-waste generative toolkit to democratize technology design.


title: The Emergence of Lines of Hierarchy in Collective Motion of Biological Systems

abstract: The emergence of large scale structures in biological systems, and in particular the formation of lines of hierarchy, is observed in many scales, from collections of cells to groups of insects to herds of animals. Motivated by phenomena in chemotaxis and phototaxis, we present a new class of alignment models which exhibit alignment into lines. The spontaneous formation of such ``fingers" can be interpreted as the emergence of leaders and followers in a system of identically interacting agents. Various numerical examples are provided, which demonstrate emergent behaviors similar to the ``fingering'' phenomenon observed in some phototaxis and chemotaxis experiments; this phenomenon is generally known as a challenging pattern to capture for existing models. The novel pairwise interactions provides a fundamental mechanism by which agents may form social hierarchy across a wide range of biological systems.


title: Robust Variance Estimation for Covariate-Adjusted Unconditional Treatment Effect in Randomized Clinical Trials with Binary Outcomes

abstract: To improve precision of estimation and power of testing hypothesis for an unconditional treatment effect in randomized clinical trials with binary outcomes, researchers and regulatory agencies recommend using g-computation as a reliable method of covariate adjustment. However, the practical application of g-computation is hindered by the lack of an explicit robust variance formula that can be used for different unconditional treatment effects of interest. To fill this gap, we provide explicit and robust variance estimators for g-computation estimators and demonstrate through simulations that the variance estimators can be reliably applied in practice.


title: *-homomorphisms between groupoid C*-algebras

abstract: In this paper, we investigate *-homomorphisms between C*-algebras associated to \'etale groupoids. First, we prove that such a *-homomorphism can be described by closed invariant subsets, groupoid homomorphisms and cocycles under some assumptions. Then we prove C*-rigidity results for \'etale groupoids which are not necessarily effective. As another application, we investigate certain subgroups of the automorphism groups of groupoid C*-algebras. More precisely, we show that the groups of automorphisms that globally preserve the function algebras on the unit spaces are isomorphic to certain semidirect product groups. As a corollary, we show that, if group actions on groupoid C*-algebras fix the function algebras on the unit spaces, then the actions factors through the abelianizations of the acting groups.


title: Time to Embrace Natural Language Processing (NLP)-based Digital Pathology: Benchmarking NLP- and Convolutional Neural Network-based Deep Learning Pipelines

abstract: NLP-based computer vision models, particularly vision transformers, have been shown to outperform CNN models in many imaging tasks. However, most digital pathology artificial-intelligence models are based on CNN architectures, probably owing to a lack of data regarding NLP models for pathology images. In this study, we developed digital pathology pipelines to benchmark the five most recently proposed NLP models (vision transformer (ViT), Swin Transformer, MobileViT, CMT, and Sequencer2D) and four popular CNN models (ResNet18, ResNet50, MobileNetV2, and EfficientNet) to predict biomarkers in colorectal cancer (microsatellite instability, CpG island methylator phenotype, and BRAF mutation). Hematoxylin and eosin-stained whole-slide images from Molecular and Cellular Oncology and The Cancer Genome Atlas were used as training and external validation datasets, respectively. Cross-study external validations revealed that the NLP-based models significantly outperformed the CNN-based models in biomarker prediction tasks, improving the overall prediction and precision up to approximately 10% and 26%, respectively. Notably, compared with existing models in the current literature using large training datasets, our NLP models achieved state-of-the-art predictions for all three biomarkers using a relatively small training dataset, suggesting that large training datasets are not a prerequisite for NLP models or transformers, and NLP may be more suitable for clinical studies in which small training datasets are commonly collected. The superior performance of Sequencer2D suggests that further research and innovation on both transformer and bidirectional long short-term memory architectures are warranted in the field of digital pathology. NLP models can replace classic CNN architectures and become the new workhorse backbone in the field of digital pathology.


title: Label Information Enhanced Fraud Detection against Low Homophily in Graphs

abstract: Node classification is a substantial problem in graph-based fraud detection. Many existing works adopt Graph Neural Networks (GNNs) to enhance fraud detectors. While promising, currently most GNN-based fraud detectors fail to generalize to the low homophily setting. Besides, label utilization has been proved to be significant factor for node classification problem. But we find they are less effective in fraud detection tasks due to the low homophily in graphs. In this work, we propose GAGA, a novel Group AGgregation enhanced TrAnsformer, to tackle the above challenges. Specifically, the group aggregation provides a portable method to cope with the low homophily issue. Such an aggregation explicitly integrates the label information to generate distinguishable neighborhood information. Along with group aggregation, an attempt towards end-to-end trainable group encoding is proposed which augments the original feature space with the class labels. Meanwhile, we devise two additional learnable encodings to recognize the structural and relational context. Then, we combine the group aggregation and the learnable encodings into a Transformer encoder to capture the semantic information. Experimental results clearly show that GAGA outperforms other competitive graph-based fraud detectors by up to 24.39% on two trending public datasets and a real-world industrial dataset from Anonymous. Even more, the group aggregation is demonstrated to outperform other label utilization methods (e.g., C&S, BoT/UniMP) in the low homophily setting.


title: Scenario-based Optimization Models for Power Grid Resilience to Extreme Flooding Events

abstract: We propose two scenario-based optimization models for power grid resilience decision making that integrate output from a hydrology model with a power flow model. The models are used to identify an optimal substation hardening strategy against potential flooding from storms for a given investment budget, which if implemented enhances the resilience of the power grid, minimizing the power demand that is shed. The same models can alternatively be used to determine the optimal budget that should be allocated for substation hardening when long-term forecasts of storm frequency and impact (specifically restoration times) are available. The two optimization models differ in terms of capturing risk attitude: one minimizes the average load shed for given scenario probabilities and the other minimizes the worst-case load shed without needing scenario probabilities. To demonstrate the efficacy of the proposed models, we further develop a case study for the Texas Gulf Coast using storm surge maps developed by the National Oceanic and Atmospheric Administration and a synthetic power grid for the state of Texas developed as part of an ARPA-E project. For a reasonable choice of parameters, we show that a scenario-based representation of uncertainty can offer a significant improvement in minimizing load shed as compared to using point estimates or average flood values. We further show that when the available investment budget is relatively high, solutions that minimize the worst-case load shed can offer several advantages as compared to solutions obtained from minimizing the average load shed. Lastly, we show that even for relatively low values of load loss and short post-hurricane power restoration times, it is optimal to make significant investments in substation hardening to deal with the storm surge considered in the NOAA flood scenarios.


title: Mean Parity Fair Regression in RKHS

abstract: We study the fair regression problem under the notion of Mean Parity (MP) fairness, which requires the conditional mean of the learned function output to be constant with respect to the sensitive attributes. We address this problem by leveraging reproducing kernel Hilbert space (RKHS) to construct the functional space whose members are guaranteed to satisfy the fairness constraints. The proposed functional space suggests a closed-form solution for the fair regression problem that is naturally compatible with multiple sensitive attributes. Furthermore, by formulating the fairness-accuracy tradeoff as a relaxed fair regression problem, we derive a corresponding regression function that can be implemented efficiently and provides interpretable tradeoffs. More importantly, under some mild assumptions, the proposed method can be applied to regression problems with a covariance-based notion of fairness. Experimental results on benchmark datasets show the proposed methods achieve competitive and even superior performance compared with several state-of-the-art methods.


title: $T \overline{T}$-Like Flows and $3d$ Nonlinear Supersymmetry

abstract: We show that the $3d$ Born-Infeld theory can be generated via an irrelevant deformation of the free Maxwell theory. The deforming operator is constructed from the energy-momentum tensor and includes a novel non-analytic contribution that resembles root-$T \overline{T}$. We find that a similar operator deforms a free scalar into the scalar sector of the Dirac-Born-Infeld action, which describes transverse fluctuations of a D-brane, in any dimension. We also analyse trace flow equations and obtain flows for subtracted models driven by a relevant operator. In $3d$, the irrelevant deformation can be made manifestly supersymmetric by presenting the flow equation in $\mathcal{N} = 1$ superspace, where the deforming operator is built from supercurrents. We demonstrate that two supersymmetric presentations of the D2-brane effective action, the Maxwell-Goldstone multiplet and the tensor-Goldstone multiplet, satisfy superspace flow equations driven by this supercurrent combination. To do this, we derive expressions for the supercurrents in general classes of vector and tensor/scalar models by directly solving the superspace conservation equations and also by coupling to $\mathcal{N} = 1$ supergravity. As both of these multiplets exhibit a second, spontaneously broken supersymmetry, this analysis provides further evidence for a connection between current-squared deformations and nonlinearly realized symmetries.


title: Regret Analysis of Online LQR Control via Trajectory Prediction and Tracking: Extended Version

abstract: In this paper, we propose and analyze a new method for online linear quadratic regulator (LQR) control with a priori unknown time-varying cost matrices. The cost matrices are revealed sequentially with the potential for future values to be previewed over a short window. Our novel method involves using the available cost matrices to predict the optimal trajectory, and a tracking controller to drive the system towards it. We adopted the notion of dynamic regret to measure the performance of this proposed online LQR control method, with our main result being that the (dynamic) regret of our method is upper bounded by a constant. Moreover, the regret upper bound decays exponentially with the preview window length, and is extendable to systems with disturbances. We show in simulations that our proposed method offers improved performance compared to other previously proposed online LQR methods.


title: Non-pooling Network for medical image segmentation

abstract: Existing studies tend tofocus onmodel modifications and integration with higher accuracy, which improve performance but also carry huge computational costs, resulting in longer detection times. Inmedical imaging, the use of time is extremely sensitive. And at present most of the semantic segmentation models have encoder-decoder structure or double branch structure. Their several times of the pooling use with high-level semantic information extraction operation cause information loss although there si a reverse pooling or other similar action to restore information loss of pooling operation. In addition, we notice that visual attention mechanism has superior performance on a variety of tasks. Given this, this paper proposes non-pooling network(NPNet), non-pooling commendably reduces the loss of information and attention enhancement m o d u l e ( A M ) effectively increases the weight of useful information. The method greatly reduces the number of parametersand computation costs by the shallow neural network structure. We evaluate the semantic segmentation model of our NPNet on three benchmark datasets comparing w i t h multiple current state-of-the-art(SOTA) models, and the implementation results show thatour NPNetachieves SOTA performance, with an excellent balance between accuracyand speed.


title: CADIS: Handling Cluster-skewed Non-IID Data in Federated Learning with Clustered Aggregation and Knowledge DIStilled Regularization

abstract: Federated learning enables edge devices to train a global model collaboratively without exposing their data. Despite achieving outstanding advantages in computing efficiency and privacy protection, federated learning faces a significant challenge when dealing with non-IID data, i.e., data generated by clients that are typically not independent and identically distributed. In this paper, we tackle a new type of Non-IID data, called cluster-skewed non-IID, discovered in actual data sets. The cluster-skewed non-IID is a phenomenon in which clients can be grouped into clusters with similar data distributions. By performing an in-depth analysis of the behavior of a classification model's penultimate layer, we introduce a metric that quantifies the similarity between two clients' data distributions without violating their privacy. We then propose an aggregation scheme that guarantees equality between clusters. In addition, we offer a novel local training regularization based on the knowledge-distillation technique that reduces the overfitting problem at clients and dramatically boosts the training scheme's performance. We theoretically prove the superiority of the proposed aggregation over the benchmark FedAvg. Extensive experimental results on both standard public datasets and our in-house real-world dataset demonstrate that the proposed approach improves accuracy by up to 16% compared to the FedAvg algorithm.


title: Improving Scene Text Image Super-resolution via Dual Prior Modulation Network

abstract: Scene text image super-resolution (STISR) aims to simultaneously increase the resolution and legibility of the text images, and the resulting images will significantly affect the performance of downstream tasks. Although numerous progress has been made, existing approaches raise two crucial issues: (1) They neglect the global structure of the text, which bounds the semantic determinism of the scene text. (2) The priors, e.g., text prior or stroke prior, employed in existing works, are extracted from pre-trained text recognizers. That said, such priors suffer from the domain gap including low resolution and blurriness caused by poor imaging conditions, leading to incorrect guidance. Our work addresses these gaps and proposes a plug-and-play module dubbed Dual Prior Modulation Network (DPMN), which leverages dual image-level priors to bring performance gain over existing approaches. Specifically, two types of prior-guided refinement modules, each using the text mask or graphic recognition result of the low-quality SR image from the preceding layer, are designed to improve the structural clarity and semantic accuracy of the text, respectively. The following attention mechanism hence modulates two quality-enhanced images to attain a superior SR result. Extensive experiments validate that our method improves the image quality and boosts the performance of downstream tasks over five typical approaches on the benchmark. Substantial visualizations and ablation studies demonstrate the advantages of the proposed DPMN. Code is available at: https://github.com/jdfxzzy/DPMN.


title: A survey of Computations of Bredon Cohomology

abstract: We present an overview of computational methods for Bredon cohomology with a special focus on infinite groups


title: Joint Communication, Sensing and Computation enabled 6G Intelligent Machine System

abstract: With the rapid development of the smart city, high-level autonomous driving, intelligent manufacturing, and etc., the stringent industrial-level requirements of the extremely low latency and high reliability for communication and new trends for sub-centimeter sensing have transcended the abilities of 5G and call for the development of 6G. Based on analyzing the function design of the communication, sensing and the emerging intelligent computation systems, we propose the joint communication, sensing and computation (JCSC) framework for 6G intelligent machine-type communication (IMTC) network to realize low latency and high reliability of communication, highly accurate sensing and fast environment adaption. In the proposed JCSC framework, the communication, sensing and computation abilities cooperate to benefit each other by utilizing the unified hardware, resource and protocol design. Sensing information is exploited as priori information to enhance the reliability and latency performance of wireless communication and to optimize the resource utilization of the communication network, which further improves the distributed computation and cooperative sensing ability. We propose the promising enabling technologies such as joint communication and sensing (JCS) technique, JCSC wireless networking techniques and intelligent computation techniques. We also summarize the challenges to achieve the JCSC framework. Then, we introduce the intelligent flexible manufacturing as a typical use case of the IMTC with JCSC framework, where the enabling technologies are deployed. Finally, we present the simulation results to prove the feasibility of the JCSC framework by evaluating the JCS waveform, the JCSC enabled neighbor discovery (ND) and medium access control (MAC).


title: FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning

abstract: Vertical Federated Learning (VFL) enables multiple data owners, each holding a different subset of features about largely overlapping sets of data sample(s), to jointly train a useful global model. Feature selection (FS) is important to VFL. It is still an open research problem as existing FS works designed for VFL either assumes prior knowledge on the number of noisy features or prior knowledge on the post-training threshold of useful features to be selected, making them unsuitable for practical applications. To bridge this gap, we propose the Federated Stochastic Dual-Gate based Feature Selection (FedSDG-FS) approach. It consists of a Gaussian stochastic dual-gate to efficiently approximate the probability of a feature being selected, with privacy protection through Partially Homomorphic Encryption without a trusted third-party. To reduce overhead, we propose a feature importance initialization method based on Gini impurity, which can accomplish its goals with only two parameter transmissions between the server and the clients. Extensive experiments on both synthetic and real-world datasets show that FedSDG-FS significantly outperforms existing approaches in terms of achieving accurate selection of high-quality features as well as building global models with improved performance.


title: MAC-PO: Multi-Agent Experience Replay via Collective Priority Optimization

abstract: Experience replay is crucial for off-policy reinforcement learning (RL) methods. By remembering and reusing the experiences from past different policies, experience replay significantly improves the training efficiency and stability of RL algorithms. Many decision-making problems in practice naturally involve multiple agents and require multi-agent reinforcement learning (MARL) under centralized training decentralized execution paradigm. Nevertheless, existing MARL algorithms often adopt standard experience replay where the transitions are uniformly sampled regardless of their importance. Finding prioritized sampling weights that are optimized for MARL experience replay has yet to be explored. To this end, we propose MAC-PO, which formulates optimal prioritized experience replay for multi-agent problems as a regret minimization over the sampling weights of transitions. Such optimization is relaxed and solved using the Lagrangian multiplier approach to obtain the close-form optimal sampling weights. By minimizing the resulting policy regret, we can narrow the gap between the current policy and a nominal optimal policy, thus acquiring an improved prioritization scheme for multi-agent tasks. Our experimental results on Predator-Prey and StarCraft Multi-Agent Challenge environments demonstrate the effectiveness of our method, having a better ability to replay important transitions and outperforming other state-of-the-art baselines.


title: A Heuristic Autonomous Exploration Method Based on Environmental Information Gain During Quadrotor Flight

abstract: Autonomous exploration is a widely studied fundamental application in the field of quadrotors, which requires them to automatically explore unknown space to obtain complete information about the environment. The frontier-based method, which is one of the representative works on autonomous exploration, drives autonomous determination by the definition of frontier information, so that complete information about the environment is available to the quadrotor. However, existing frontier-based methods are able to accomplish the task but still suffer from inefficient exploration. How to improve the efficiency of autonomous exploration is the focus of current research. Typical problems include slow frontier generation, which affects real-time viewpoint determination, and insufficient determination methods that affect the quality of viewpoints. Therefore, to overcome these problems, this paper proposes a two-level viewpoint determination method for frontier-based autonomous exploration. Firstly, a sampling-based frontier detection method is presented for faster frontier generation, which improves the immediacy of environmental representation compared to traditional traversal-based methods. Secondly, we consider the access to environmental information during flight for the first time and design an innovative heuristic evaluation function to decide on a high-quality viewpoint as the next local navigation target in each exploration iteration. We conducted extensive benchmark and real-world tests to validate our method. The results confirm that our method optimizes the frontier search time by 85%, the exploration time by around 20-30%, and the exploration path by 25-35%.


title: HCGMNET: A Hierarchical Change Guiding Map Network For Change Detection

abstract: Very-high-resolution (VHR) remote sensing (RS) image change detection (CD) has been a challenging task for its very rich spatial information and sample imbalance problem. In this paper, we have proposed a hierarchical change guiding map network (HCGMNet) for change detection. The model uses hierarchical convolution operations to extract multiscale features, continuously merges multi-scale features layer by layer to improve the expression of global and local information, and guides the model to gradually refine edge features and comprehensive performance by a change guide module (CGM), which is a self-attention with changing guide map. Extensive experiments on two CD datasets show that the proposed HCGMNet architecture achieves better CD performance than existing state-of-the-art (SOTA) CD methods.


title: Crowd simulation incorporating a route choice model and similarity evaluation using real large-scale data

abstract: Modeling and simulation approaches that express crowd movement with mathematical models are widely and actively studied to understand crowd movement and resolve crowd accidents. Existing literature on crowd modeling focuses on only the decision-making of walking behavior. However, the decision-making of route choice, which is a higher-level decision, should also be modeled for constructing more practical simulations. Furthermore, the reproducibility evaluation of the crowd simulation incorporating the route choice model using real data is insufficient. Therefore, we generalize and propose a crowd simulation framework that includes actual crowd movement measurements, route choice model estimation, and crowd simulator construction. We use the Discrete choice model as the route choice model and the Social force model as the walking model. In experiments, we measure crowd movements during an evacuation drill in a theater and a firework event where tens of thousands of people moved and prove that the crowd simulation incorporating the route choice model can reproduce the real large-scale crowd movement more accurately.


title: Fe$_{1+y}$Te$_{x}$Se$_{1-x}$: a delicate and tunable Majorana material

abstract: We report the observation for the p$_{z}$ electron band and the band inversion in Fe$_{1+y}$Te$_{x}$Se$_{1-x}$ with angle-resolved photoemission spectroscopy. Furthermore, we found that excess Fe (y>0) inhibits the topological band inversion in Fe$_{1+y}$Te$_{x}$Se$_{1-x}$, which explains the absence of Majorana zero modes in previous reports for Fe$_{1+y}$Te$_{x}$Se$_{1-x}$ with excess Fe. Based on our analysis of different amounts of Te doping and excess Fe, we propose a delicate topological phase in this material. Thanks to this delicate phase, one may be able to tune the topological transition via applying lattice strain or carrier doping.


title: Criminal Investigation Tracker with Suspect Prediction using Machine Learning

abstract: An automated approach to identifying offenders in Sri Lanka would be better than the current system. Obtaining information from eyewitnesses is one of the less reliable approaches and procedures still in use today. Automated criminal identification has the ability to save lives, notwithstanding Sri Lankan culture's lack of awareness of the issue. Using cutting-edge technology like biometrics to finish this task would be the most accurate strategy. The most notable outcomes will be obtained by applying fingerprint and face recognition as biometric techniques. The main responsibilities will be image optimization and criminality. CCTV footage may be used to identify a person's fingerprint, identify a person's face, and identify crimes involving weapons. Additionally, we unveil a notification system and condense the police report to Additionally, to make it simpler for police officers to understand the essential points of the crime, we develop a notification system and condense the police report. Additionally, if an incident involving a weapon is detected, an automated notice of the crime with all the relevant facts is sent to the closest police station. The summarization of the police report is what makes this the most original. In order to improve the efficacy of the overall image, the system will quickly and precisely identify the full crime scene, identify, and recognize the suspects using their faces and fingerprints, and detect firearms. This study provides a novel approach for crime prediction based on real-world data, and criminality incorporation. A crime or occurrence should be reported to the appropriate agencies, and the suggested web application should be improved further to offer a workable channel of communication.


title: Deep Learning via Neural Energy Descent

abstract: This paper proposes the Nerual Energy Descent (NED) via neural network evolution equations for a wide class of deep learning problems. We show that deep learning can be reformulated as the evolution of network parameters in an evolution equation and the steady state solution of the partial differential equation (PDE) provides a solution to deep learning. This equation corresponds to a gradient descent flow of a variational problem and hence the proposed time-dependent PDE solves an energy minimization problem to obtain a global minimizer of deep learning. This gives a novel interpretation and solution to deep learning optimization. The computational complexity of the proposed energy descent method can be enhanced by randomly sampling the spatial domain of the PDE leading to an efficient NED. Numerical examples are provided to demonstrate the numerical advantage of NED over stochastic gradient descent (SGD).


title: Instance-incremental Scene Graph Generation from Real-world Point Clouds via Normalizing Flows

abstract: This work introduces a new task of instance-incremental scene graph generation: Given a scene of the point cloud, representing it as a graph and automatically increasing novel instances. A graph denoting the object layout of the scene is finally generated. It is an important task since it helps to guide the insertion of novel 3D objects into a real-world scene in vision-based applications like augmented reality. It is also challenging because the complexity of the real-world point cloud brings difficulties in learning object layout experiences from the observation data (non-empty rooms with labeled semantics). We model this task as a conditional generation problem and propose a 3D autoregressive framework based on normalizing flows (3D-ANF) to address it. First, we represent the point cloud as a graph by extracting the label semantics and contextual relationships. Next, a model based on normalizing flows is introduced to map the conditional generation of graphic elements into the Gaussian process. The mapping is invertible. Thus, the real-world experiences represented in the observation data can be modeled in the training phase, and novel instances can be autoregressively generated based on the Gaussian process in the testing phase. To evaluate the performance of our method sufficiently, we implement this new task on the indoor benchmark dataset 3DSSG-O27R16 and our newly proposed graphical dataset of outdoor scenes GPL3D. Experiments show that our method generates reliable novel graphs from the real-world point cloud and achieves state-of-the-art performance on the datasets.


title: AttentionMixer: An Accurate and Interpretable Framework for Process Monitoring

abstract: An accurate and explainable automatic monitoring system is critical for the safety of high efficiency energy conversion plants that operate under extreme working condition. Nonetheless, currently available data-driven monitoring systems often fall short in meeting the requirements for either high-accuracy or interpretability, which hinders their application in practice. To overcome this limitation, a data-driven approach, AttentionMixer, is proposed under a generalized message passing framework, with the goal of establishing an accurate and interpretable radiation monitoring framework for energy conversion plants. To improve the model accuracy, the first technical contribution involves the development of spatial and temporal adaptive message passing blocks, which enable the capture of spatial and temporal correlations, respectively; the two blocks are cascaded through a mixing operator. To enhance the model interpretability, the second technical contribution involves the implementation of a sparse message passing regularizer, which eliminates spurious and noisy message passing routes. The effectiveness of the AttentionMixer approach is validated through extensive evaluations on a monitoring benchmark collected from the national radiation monitoring network for nuclear power plants, resulting in enhanced monitoring accuracy and interpretability in practice.


title: Escaping Local Minima with Quantum Coherent Cooling

abstract: Quantum cooling has demonstrated its potential in quantum computing, which can reduce the number of control channels needed for external signals. Recent progress also supports the possibility of maintaining quantum coherence in large-scale systems. The limitations of classical algorithms trapped in local minima of cost functions could be overcome using this scheme. According to this, we propose a hybrid quantum-classical algorithm for finding the global minima. Our approach utilizes quantum coherent cooling to facilitate coordinative tunneling through energy barriers if the classical algorithm gets stuck. The encoded Hamiltonian system represents the cost function, and a quantum coherent bath in the ground state serves as a heat sink to absorb energy from the system. Our proposed scheme can be implemented in the circuit quantum electrodynamics (cQED) system using a quantum cavity. The provided numerical evidence demonstrates the quantum advantage in solving spin glass problems.


title: A Dynamic Temporal Self-attention Graph Convolutional Network for Traffic Prediction

abstract: Accurate traffic prediction in real time plays an important role in Intelligent Transportation System (ITS) and travel navigation guidance. There have been many attempts to predict short-term traffic status which consider the spatial and temporal dependencies of traffic information such as temporal graph convolutional network (T-GCN) model and convolutional long short-term memory (Conv-LSTM) model. However, most existing methods use simple adjacent matrix consisting of 0 and 1 to capture the spatial dependence which can not meticulously describe the urban road network topological structure and the law of dynamic change with time. In order to tackle the problem, this paper proposes a dynamic temporal self-attention graph convolutional network (DT-SGN) model which considers the adjacent matrix as a trainable attention score matrix and adapts network parameters to different inputs. Specially, self-attention graph convolutional network (SGN) is chosen to capture the spatial dependence and the dynamic gated recurrent unit (Dynamic-GRU) is chosen to capture temporal dependence and learn dynamic changes of input data. Experiments demonstrate the superiority of our method over state-of-art model-driven model and data-driven models on real-world traffic datasets.


title: FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy

abstract: Federated learning is an emerging distributed machine learning framework which jointly trains a global model via a large number of local devices with data privacy protections. Its performance suffers from the non-vanishing biases introduced by the local inconsistent optimal and the rugged client-drifts by the local over-fitting. In this paper, we propose a novel and practical method, FedSpeed, to alleviate the negative impacts posed by these problems. Concretely, FedSpeed applies the prox-correction term on the current local updates to efficiently reduce the biases introduced by the prox-term, a necessary regularizer to maintain the strong local consistency. Furthermore, FedSpeed merges the vanilla stochastic gradient with a perturbation computed from an extra gradient ascent step in the neighborhood, thereby alleviating the issue of local over-fitting. Our theoretical analysis indicates that the convergence rate is related to both the communication rounds $T$ and local intervals $K$ with a upper bound $\small \mathcal{O}(1/T)$ if setting a proper local interval. Moreover, we conduct extensive experiments on the real-world dataset to demonstrate the efficiency of our proposed FedSpeed, which performs significantly faster and achieves the state-of-the-art (SOTA) performance on the general FL experimental settings than several baselines. Our code is available at \url{https://github.com/woodenchild95/FL-Simulator.git}.


title: Interval Type-2 Fuzzy Neural Networks for Multi-Label Classification

abstract: Prediction of multi-dimensional labels plays an important role in machine learning problems. We found that the classical binary labels could not reflect the contents and their relationships in an instance. Hence, we propose a multi-label classification model based on interval type-2 fuzzy logic. In the proposed model, we use a deep neural network to predict the type-1 fuzzy membership of an instance and another one to predict the fuzzifiers of the membership to generate interval type-2 fuzzy memberships. We also propose a loss function to measure the similarities between binary labels in datasets and interval type-2 fuzzy memberships generated by our model. The experiments validate that our approach outperforms baselines on multi-label classification benchmarks.


title: A note on the partition bound for one-way classical communication complexity

abstract: We present a linear program for the one-way version of the partition bound (denoted $\mathsf{prt}^1_\varepsilon(f)$). We show that it characterizes one-way randomized communication complexity $\mathsf{R}_\varepsilon^1(f)$ with shared randomness of every partial function $f:\mathcal{X}\times\mathcal{Y}\to\mathcal{Z}$, i.e., for $\delta,\varepsilon\in(0,1/2)$, $\mathsf{R}_\varepsilon^1(f) \geq \log\mathsf{prt}_\varepsilon^1(f)$ and $\mathsf{R}_{\varepsilon+\delta}^1(f) \leq \log\mathsf{prt}_\varepsilon^1(f) + \log\log(1/\delta)$. This improves upon the characterization of $\mathsf{R}_\varepsilon^1(f)$ in terms of the rectangle bound (due to Jain and Klauck, 2010) by reducing the additive $O(\log(1/\delta))$-term to $\log\log(1/\delta)$.