title: New constraints on the dark matter-neutrino and dark matter-photon scattering cross sections from TXS 0506+056

abstract: The flux of high energy neutrinos and photons produced in a blazar could get attenuated when they propagate through the dark matter spike around the central black hole and the halo of the host galaxy. Using the observation by IceCube of a few high-energy neutrino events from TXS 0506+056, and their coincident gamma ray events, we obtain new constraints on the dark matter-neutrino and dark matter-photon scattering cross sections. Our constraints are orders of magnitude more stringent than those derived from considering the attenuation through the intergalactic medium and the Milky Way dark matter halo. When the cross-section increases with energy, our constraints are also stronger than those derived from the CMB and large-scale structure.


title: Optimal Data Acquisition with Privacy-Aware Agents

abstract: We study the problem faced by a data analyst or platform that wishes to collect private data from privacy-aware agents. To incentivize participation, in exchange for this data, the platform provides a service to the agents in the form of a statistic computed using all agents' submitted data. The agents decide whether to join the platform (and truthfully reveal their data) or not participate by considering both the privacy costs of joining and the benefit they get from obtaining the statistic. The platform must ensure the statistic is computed differentially privately and chooses a central level of noise to add to the computation, but can also induce personalized privacy levels (or costs) by giving different weights to different agents in the computation as a function of their heterogeneous privacy preferences (which are known to the platform). We assume the platform aims to optimize the accuracy of the statistic, and must pick the privacy level of each agent to trade-off between i) incentivizing more participation and ii) adding less noise to the estimate. We provide a semi-closed form characterization of the optimal choice of agent weights for the platform in two variants of our model. In both of these models, we identify a common nontrivial structure in the platform's optimal solution: an instance-specific number of agents with the least stringent privacy requirements are pooled together and given the same weight, while the weights of the remaining agents decrease as a function of the strength of their privacy requirement. We also provide algorithmic results on how to find the optimal value of the noise parameter used by the platform and of the weights given to the agents.


title: Decarbonizing OCP

abstract: We present our collaboration with the OCP Group, one of the world's largest producers of phosphate and phosphate-based products, to reduce OCP's carbon emissions significantly. We study the problem of decarbonizing OCP's electricity supply by installing a mixture of solar panels and batteries to minimize its time-discounted investment cost plus the cost of satisfying its remaining demand via the national grid. OCP is currently designing its renewable investment strategy, using insights gleaned from our optimization model, and has pledged to invest 130 billion MAD (approx. 13 billion USD) in a green initiative by 2027, a subset of which involves decarbonization. We immunize our model against deviations between forecast and realized solar generation output via a combination of robust and distributionally robust optimization. To account for variability in daily solar generation, we propose a data-driven robust optimization approach that prevents excessive conservatism by averaging across uncertainty sets. To protect against variability in seasonal weather patterns induced by climate change, we invoke distributionally robust optimization techniques. Under a 10 billion MAD investment by OCP, the proposed methodology reduces the carbon emissions which arise from OCP's energy needs by more than 70% while generating a net present value (NPV) of 5 billion MAD over twenty years. Moreover, a 20 billion MAD investment induces a 95% reduction in carbon emissions and generates an NPV of around 2 billion MAD. To fulfill the Paris climate agreement, rapidly decarbonizing the global economy in a financially sustainable fashion is imperative. Accordingly, this work develops a robust optimization methodology that enables OCP to decarbonize at a profit by purchasing solar panels and batteries. Moreover, the methodology could be applied to decarbonize other industrial consumers.


title: Stochastic homogenization of a porous-medium type equation

abstract: We consider the homogenization problem for the stochastic porous-medium type equation $\p_{t} u^\epsilon =\Delta f\left(T\left(\frac{x}{\ep}\right)\om,u^\ep\right)$, with a well-prepared initial datum, where $f(T(y)\om,u)$ is a stationary process, increasing in $u$, on a given probability space $(\Om, \mathcal{F}, \mu)$ endowed with an ergodic dynamical system $\{T(y)\,:\,y\in\R^N\}$. Differently from the previous literature \cite{afs,fs}, here we do not assume $\Om$ compact. We first show that the weak solution $u^\ep$ satisfies a kinetic formulation of the equation, then we exploit the theory of "stochastically two-scale convergence in the mean" developed in \cite{bmw} to show convergence of the kinetic solution to the kinetic solution of an homogenized problem of the form $\p_{t} \overline{u} - \Delta \overline{f}(\overline{u})=0$. The homogenization result for the weak solutions then follows.


title: Do Periods of Decayless Kink Oscillations of Solar Coronal Loops Depend on Noise?

abstract: Decayless kink oscillations of solar coronal loops are studied in terms of a low-dimensional model based on a randomly driven Rayleigh oscillator with coefficients experiencing random fluctuations. The model considers kink oscillations as natural modes of coronal loops, decaying by linear resonant absorption. The damping is counteracted by random motions of the loop footpoints and the interaction of the loop with external quasi-steady flows with random fluctuations. In other words, the model combines the self-oscillatory and randomly driven mechanisms for the decayless behaviour. The random signals are taken to be of the stationary red noise nature. In the noiseless case, the model has an asymptotically stationary oscillatory solution, i.e., a kink self-oscillation. It is established that the kink oscillation period is practically independent of noise. This finding justifies the seismological estimations of the kink and Alfv\'en speeds and the magnetic field in an oscillating loop by kink oscillations, based on the observed oscillation period. The oscillatory patterns are found to be almost harmonic. Noisy fluctuations of external flows modulate the amplitude of the almost monochromatic oscillatory pattern symmetrically, while random motions of the loop footpoints cause antisymmetric amplitude modulation. Such modulations are also consistent with the observed behaviour.


title: CNN-Trans-Enc: A CNN-Enhanced Transformer-Encoder On Top Of Static BERT representations for Document Classification

abstract: BERT achieves remarkable results in text classification tasks, it is yet not fully exploited, since only the last layer is used as a representation output for downstream classifiers. The most recent studies on the nature of linguistic features learned by BERT, suggest that different layers focus on different kinds of linguistic features. We propose a CNN-Enhanced Transformer-Encoder model which is trained on top of fixed BERT $[CLS]$ representations from all layers, employing Convolutional Neural Networks to generate QKV feature maps inside the Transformer-Encoder, instead of linear projections of the input into the embedding space. CNN-Trans-Enc is relatively small as a downstream classifier and doesn't require any fine-tuning of BERT, as it ensures an optimal use of the $[CLS]$ representations from all layers, leveraging different linguistic features with more meaningful, and generalizable QKV representations of the input. Using BERT with CNN-Trans-Enc keeps $98.9\%$ and $94.8\%$ of current state-of-the-art performance on the IMDB and SST-5 datasets respectably, while obtaining new state-of-the-art on YELP-5 with $82.23$ ($8.9\%$ improvement), and on Amazon-Polarity with $0.98\%$ ($0.2\%$ improvement) (K-fold Cross Validation on a 1M sample subset from both datasets). On the AG news dataset CNN-Trans-Enc achieves $99.94\%$ of the current state-of-the-art, and achieves a new top performance with an average accuracy of $99.51\%$ on DBPedia-14. Index terms: Text Classification, Natural Language Processing, Convolutional Neural Networks, Transformers, BERT


title: Self-supervised Multi-Modal Video Forgery Attack Detection

abstract: Video forgery attack threatens the surveillance system by replacing the video captures with unrealistic synthesis, which can be powered by the latest augment reality and virtual reality technologies. From the machine perception aspect, visual objects often have RF signatures that are naturally synchronized with them during recording. In contrast to video captures, the RF signatures are more difficult to attack given their concealed and ubiquitous nature. In this work, we investigate multimodal video forgery attack detection methods using both vision and wireless modalities. Since wireless signal-based human perception is environmentally sensitive, we propose a self-supervised training strategy to enable the system to work without external annotation and thus can adapt to different environments. Our method achieves a perfect human detection accuracy and a high forgery attack detection accuracy of 94.38% which is comparable with supervised methods.


title: Prediction of the outcome of a Twenty-20 Cricket Match : A Machine Learning Approach

abstract: Twenty20 cricket, sometimes written Twenty-20, and often abbreviated to T20, is a short form of cricket. In a Twenty20 game the two teams of 11 players have a single innings each, which is restricted to a maximum of 20 overs. This version of cricket is especially unpredictable and is one of the reasons it has gained popularity over recent times. However, in this paper we try four different machine learning approaches for predicting the results of T20 Cricket Matches. Specifically we take in to account: previous performance statistics of the players involved in the competing teams, ratings of players obtained from reputed cricket statistics websites, clustering the players' with similar performance statistics and propose a novel method using an ELO based approach to rate players. We compare the performances of each of these feature engineering approaches by using different ML algorithms, including logistic regression, support vector machines, bayes network, decision tree, random forest.


title: Ab Initio Calculations of XUV Ground and Excited States for First-Row Transition Metal Oxides

abstract: Transient X-ray spectroscopies have become ubiquitous in studying photoexcited dynamics in solar energy materials due to their sensitivity to carrier occupations and local chemical or structural dynamics. The interpretation of solid-state photoexcited dynamics, however, is complicated by the core-hole perturbation and the resulting many-body dynamics. Here, an ab initio, Bethe-Salpeter equation (BSE) approach is developed that can incorporate photoexcited state effects for solid-state materials. The extreme ultraviolet (XUV) absorption spectra for the ground, photoexcited, and thermally expanded states of first row transition metal oxides - $TiO_2, \alpha-Cr_2O_3, \beta-MnO_2, \alpha-Fe_2O_3, Co_3O_4, NiO, CuO, and ZnO$ - are calculated to demonstrate the accuracy of this approach. The theory is used to decompose the core-valence excitons into the separate components of the X-ray transition Hamiltonian for each of the transition metal oxides investigated. The decomposition provides a physical intuition about the origins of XUV spectral features as well as how the spectra will change following photoexcitation. The method is easily generalized to other K, L, M, and N edges to provide a general approach for analyzing transient X-ray absorption or reflection data.


title: COVID-19 Regional Waves and Spread Risk Assessment through the Analysis of the Initial Outbreak in Guatemala

abstract: The initial surge of the COVID-19 pandemic hit Guatemala on March 2020. On a country scale, the epidemic has undergone a fairly well-known and distinguishable initial phase, reaching its peak on mid July 2020. However, the detailed picture is more involved and reflects inter-regional variations in the epidemic dynamics, presumably grounded on socio-demographic, connectivity, and human mobility factors. Classifying the regional epidemic curves and identifying the major hubs of regional COVID-19 spread can contribute towards defining an evidence-based risk map for future outbreaks of infectious diseases with similar transmissibility properties. In this work, we make a regional wave decomposition of the initial epidemic phase registered in Guatemala, and we use the Richards phenomenological model alongside multivariate ordination techniques of its estimated model parameters to draw a countrywide picture of the first epidemiological wave. By exploring similarities in the model space parameters, we traced routes for the disease spread across the country. We evaluated how well the proposed classification can help to define a regional risk hierarchy comprising early stage focal points, major hubs, and secondary regions of epidemic progression.


title: Eigenpolytope Universality and Graphical Designs

abstract: We show that the eigenpolytopes of graphs are universal in the sense that every polytope, up to affine equivalence, appears as the eigenpolytope of some positively weighted graph. We next extend the theory of graphical designs, which are quadrature rules for graphs, to positively weighted graphs. Through Gale duality for polytopes, we show a bijection between graphical designs and the faces of eigenpolytopes. This bijection proves the existence of graphical designs with positive quadrature weights, and upper bounds the size of a minimal graphical design. Connecting this bijection with the universality of eigenpolytopes, we establish three complexity results: it is strongly NP-complete to determine if there is a graphical design smaller than the mentioned upper bound, it is NP-hard to find a smallest graphical design, and it is #P-complete to count the number of minimal graphical designs.


title: The effects of surface fossil magnetic fields on massive star evolution: IV. Grids of models at Solar, LMC, and SMC metallicities

abstract: Magnetic fields can drastically change predictions of evolutionary models of massive stars via mass-loss quenching, magnetic braking, and efficient angular momentum transport, which we aim to quantify in this work. We use the MESA software instrument to compute an extensive main-sequence grid of stellar structure and evolution models, as well as isochrones, accounting for the effects attributed to a surface fossil magnetic field. The grid is densely populated in initial mass (3-60 M$_\odot$), surface equatorial magnetic field strength (0-50 kG), and metallicity (representative of the Solar neighbourhood and the Magellanic Clouds). We use two magnetic braking and two chemical mixing schemes and compare the model predictions for slowly-rotating, nitrogen-enriched ("Group 2") stars with observations in the Large Magellanic Cloud. We quantify a range of initial field strengths that allow for producing Group 2 stars and find that typical values (up to a few kG) lead to solutions. Between the subgrids, we find notable departures in surface abundances and evolutionary paths. In our magnetic models, chemical mixing is always less efficient compared to non-magnetic models due to the rapid spin-down. We identify that quasi-chemically homogeneous main sequence evolution by efficient mixing could be prevented by fossil magnetic fields. We recommend comparing this grid of evolutionary models with spectropolarimetric and spectroscopic observations with the goals of i) revisiting the derived stellar parameters of known magnetic stars, and ii) observationally constraining the uncertain magnetic braking and chemical mixing schemes.


title: DevNet: Self-supervised Monocular Depth Learning via Density Volume Construction

abstract: Self-supervised depth learning from monocular images normally relies on the 2D pixel-wise photometric relation between temporally adjacent image frames. However, they neither fully exploit the 3D point-wise geometric correspondences, nor effectively tackle the ambiguities in the photometric warping caused by occlusions or illumination inconsistency. To address these problems, this work proposes Density Volume Construction Network (DevNet), a novel self-supervised monocular depth learning framework, that can consider 3D spatial information, and exploit stronger geometric constraints among adjacent camera frustums. Instead of directly regressing the pixel value from a single image, our DevNet divides the camera frustum into multiple parallel planes and predicts the pointwise occlusion probability density on each plane. The final depth map is generated by integrating the density along corresponding rays. During the training process, novel regularization strategies and loss functions are introduced to mitigate photometric ambiguities and overfitting. Without obviously enlarging model parameters size or running time, DevNet outperforms several representative baselines on both the KITTI-2015 outdoor dataset and NYU-V2 indoor dataset. In particular, the root-mean-square-deviation is reduced by around 4% with DevNet on both KITTI-2015 and NYU-V2 in the task of depth estimation. Code is available at https://github.com/gitkaichenzhou/DevNet.


title: Analytics and Machine Learning Powered Wireless Network Optimization and Planning

abstract: It is important that the wireless network is well optimized and planned, using the limited wireless spectrum resources, to serve the explosively growing traffic and diverse applications needs of end users. Considering the challenges of dynamics and complexity of the wireless systems, and the scale of the networks, it is desirable to have solutions to automatically monitor, analyze, optimize, and plan the network. This article discusses approaches and solutions of data analytics and machine learning powered optimization and planning. The approaches include analyzing some important metrics of performances and experiences, at the lower layers and upper layers of open systems interconnection (OSI) model, as well as deriving a metric of the end user perceived network congestion indicator. The approaches include monitoring and diagnosis such as anomaly detection of the metrics, root cause analysis for poor performances and experiences. The approaches include enabling network optimization with tuning recommendations, directly targeting to optimize the end users experiences, via sensitivity modeling and analysis of the upper layer metrics of the end users experiences v.s. the improvement of the lower layers metrics due to tuning the hardware configurations. The approaches also include deriving predictive metrics for network planning, traffic demand distributions and trends, detection and prediction of the suppressed traffic demand, and the incentives of traffic gains if the network is upgraded. These approaches of optimization and planning are for accurate detection of optimization and upgrading opportunities at a large scale, enabling more effective optimization and planning such as tuning cells configurations, upgrading cells capacity with more advanced technologies or new hardware, adding more cells, etc., improving the network performances and providing better experiences to end users.


title: Label Refinement Network from Synthetic Error Augmentation for Medical Image Segmentation

abstract: Deep convolutional neural networks for image segmentation do not learn the label structure explicitly and may produce segmentations with an incorrect structure, e.g., with disconnected cylindrical structures in the segmentation of tree-like structures such as airways or blood vessels. In this paper, we propose a novel label refinement method to correct such errors from an initial segmentation, implicitly incorporating information about label structure. This method features two novel parts: 1) a model that generates synthetic structural errors, and 2) a label appearance simulation network that produces synthetic segmentations (with errors) that are similar in appearance to the real initial segmentations. Using these synthetic segmentations and the original images, the label refinement network is trained to correct errors and improve the initial segmentations. The proposed method is validated on two segmentation tasks: airway segmentation from chest computed tomography (CT) scans and brain vessel segmentation from 3D CT angiography (CTA) images of the brain. In both applications, our method significantly outperformed a standard 3D U-Net and other previous refinement approaches. Improvements are even larger when additional unlabeled data is used for model training. In an ablation study, we demonstrate the value of the different components of the proposed method.


title: Tuple Packing: Efficient Batching of Small Graphs in Graph Neural Networks

abstract: When processing a batch of graphs in machine learning models such as Graph Neural Networks (GNN), it is common to combine several small graphs into one overall graph to accelerate processing and remove or reduce the overhead of padding. This is for example supported in the PyG library. However, the sizes of small graphs can vary substantially with respect to the number of nodes and edges, and hence the size of the combined graph can still vary considerably, especially for small batch sizes. Therefore, the costs of excessive padding and wasted compute are still incurred when working with static shapes, which are preferred for maximum acceleration. This paper proposes a new hardware agnostic approach -- tuple packing -- for generating batches that cause minimal overhead. The algorithm extends recently introduced sequence packing approaches to work on the 2D tuples of (|nodes|, |edges|). A monotone heuristic is applied to the 2D histogram of tuple values to define a priority for packing histogram bins together with the objective to reach a limit on the number of nodes as well as the number of edges. Experiments verify the effectiveness of the algorithm on multiple datasets.


title: Electronic polarization in non-Bloch band theory

abstract: Hermitian topological materials are characterized by the nontrivial relation between topological numbers and edge modes, i.e. the bulk-boundary correspondence. In non-Hermitian systems, the conventional correspondence breaks down. Instead, in the non-Hermitian Su-Schrieffer-Heeger model, the non-Bloch bulk-boundary correspondence, which is the relation between the non-Bloch winding number and the non-Hermitian skin effect, is proposed by S. Yao and Z. Wang. We introduce the non-Bloch polarization as a topological quantity to detect the non-Hermitian skin effect. Moreover, we also discuss the non-Bloch bulk-boundary correspondence in two-dimensional systems using the non-Bloch polarization with spiral boundary conditions.


title: Using Forwards-Backwards Models to Approximate MDP Homomorphisms

abstract: Reinforcement learning agents must painstakingly learn through trial and error what sets of state-action pairs are value equivalent -- requiring an often prohibitively large amount of environment experience. MDP homomorphisms have been proposed that reduce the MDP of an environment to an abstract MDP, enabling better sample efficiency. Consequently, impressive improvements have been achieved when a suitable homomorphism can be constructed a priori -- usually by exploiting a practitioner's knowledge of environment symmetries. We propose a novel approach to constructing homomorphisms in discrete action spaces, which uses a learnt model of environment dynamics to infer which state-action pairs lead to the same state -- which can reduce the size of the state-action space by a factor as large as the cardinality of the original action space. In MinAtar, we report an almost 4x improvement over a value-based off-policy baseline in the low sample limit, when averaging over all games and optimizers.


title: DASH: Visual Analytics for Debiasing Image Classification via User-Driven Synthetic Data Augmentation

abstract: Image classification models often learn to predict a class based on irrelevant co-occurrences between input features and an output class in training data. We call the unwanted correlations "data biases," and the visual features causing data biases "bias factors." It is challenging to identify and mitigate biases automatically without human intervention. Therefore, we conducted a design study to find a human-in-the-loop solution. First, we identified user tasks that capture the bias mitigation process for image classification models with three experts. Then, to support the tasks, we developed a visual analytics system called DASH that allows users to visually identify bias factors, to iteratively generate synthetic images using a state-of-the-art image-to-image translation model, and to supervise the model training process for improving the classification accuracy. Our quantitative evaluation and qualitative study with ten participants demonstrate the usefulness of DASH and provide lessons for future work.


title: Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset

abstract: Non-reference speech quality models are important for a growing number of applications. The VoiceMOS 2022 challenge provided a dataset of synthetic voice conversion and text-to-speech samples with subjective labels. This study looks at the amount of variance that can be explained in subjective ratings of speech quality from metadata and the distribution imbalances of the dataset. Speech quality models were constructed using wav2vec 2.0 with additional metadata features that included rater groups and system identifiers and obtained competitive metrics including a Spearman rank correlation coefficient (SRCC) of 0.934 and MSE of 0.088 at the system-level, and 0.877 and 0.198 at the utterance-level. Using data and metadata that the test restricted or blinded further improved the metrics. A metadata analysis showed that the system-level metrics do not represent the model's system-level prediction as a result of the wide variation in the number of utterances used for each system on the validation and test datasets. We conclude that, in general, conditions should have enough utterances in the test set to bound the sample mean error, and be relatively balanced in utterance count between systems, otherwise the utterance-level metrics may be more reliable and interpretable.


title: Federated Pruning: Improving Neural Network Efficiency with Federated Learning

abstract: Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective decentralized technique by collaboratively learning a shared prediction model while keeping the data local on different clients devices. However, the limited computation and communication resources on clients devices present practical difficulties for large models. To overcome such challenges, we propose Federated Pruning to train a reduced model under the federated setting, while maintaining similar performance compared to the full model. Moreover, the vast amount of clients data can also be leveraged to improve the pruning results compared to centralized training. We explore different pruning schemes and provide empirical evidence of the effectiveness of our methods.


title: I2CR: Improving Noise Robustness on Keyword Spotting Using Inter-Intra Contrastive Regularization

abstract: Noise robustness in keyword spotting remains a challenge as many models fail to overcome the heavy influence of noises, causing the deterioration of the quality of feature embeddings. We proposed a contrastive regularization method called Inter-Intra Contrastive Regularization (I2CR) to improve the feature representations by guiding the model to learn the fundamental speech information specific to the cluster. This involves maximizing the similarity across Intra and Inter samples of the same class. As a result, it pulls the instances closer to more generalized representations that form more prominent clusters and reduces the adverse impact of noises. We show that our method provides consistent improvements in accuracy over different backbone model architectures under different noise environments. We also demonstrate that our proposed framework has improved the accuracy of unseen out-of-domain noises and unseen variant noise SNRs. This indicates the significance of our work with the overall refinement in noise robustness.


title: A New Integrative Method for Multigroup Comparisons of Censored Survival Outcomes in Multiple Observational Studies

abstract: In observational studies, covariate imbalance generates confounding, resulting in biased comparisons. Although propensity score-based weighting approaches facilitate unconfounded group comparisons for implicit target populations, existing techniques may not directly or efficiently analyze multiple studies with multiple groups and provide results generalizable to larger populations. Moreover, few methods deliver precise inferences for various estimands with censored survival outcomes. We propose a new concordant target population approach, which constructs generalized balancing weights and realistic target populations. Our method can incorporate researcher-specified natural population attributes and synthesize information by appropriately compensating for over- or under-represented groups to achieve covariate balance. The constructed {concordant} weights are agnostic to specific estimators, estimands, and outcomes and maximize the effective sample size (ESS) for more precise inferences. Simulation studies and descriptive comparisons of glioblastoma outcomes of racial groups in multiple TCGA studies demonstrate the strategy's practical advantages. Unlike existing weighting techniques, the proposed concordant target population revealed a drastically different result: Blacks were more vulnerable and endured significantly worse prognoses; Asians had the best outcomes with a median overall survival of 1,024 (SE: 15.2) days, compared to 384 (SE: 1.2) and 329 (SE: 19.7) days for Whites and Blacks, respectively.


title: From weighted to unweighted graphs in Synchronizing Graph Theory

abstract: A way to associate unweighted graphs from weighted ones is presented, such that linear stable equilibria of the Kuramoto homogeneous model associated to both graphs coincide, i.e., equilibria of the system $\dot\theta_i = \sum_{j \sim i} \sin(\theta_{j}-\theta_j)$, where $i\sim j$ means vertices $i$ and $j$ are adjacent in the corresponding graph. As a consequence, the existence of linearly stable equilibrium is proved to be NP-Hard as conjectured by R. Taylor in 2015 and a new lower bound for the minimum degree that ensures synchronization is found.


title: Data Quality, Mismatched Expectations, and Moving Requirements: The Challenges of User-Centred Dashboard Design

abstract: Interactive information dashboards can help both specialists and the general public understand complex datasets; but interacting with these dashboards often presents users with challenges such as understanding and verifying the presented information. To overcome these challenges, developers first need to acquire a thorough understanding of user perspectives, including strategies that users take when presented with problematic dashboards. We interviewed seventeen dashboard developers to establish (i) their understanding of user problems, (ii) the adaptations introduced as a result, and (iii) whether user-tailored dashboards can cater for users' individual differences. We find that users' literacy does not typically align with that required to use dashboards, while dashboard developers struggle with keeping up with changing requirements. We also find that developers are able to propose solutions to most users' problems but not all. Encouragingly, our findings also highlight that tailoring dashboards to individual user needs is not only desirable, but also feasible. These findings inform future dashboard design recommendations that can mitigate the identified challenges including recommendations for data presentation and visual literacy.


title: Colourings of aperiodic tilings

abstract: We find explicit optimal vertex, edge and face coulourings for the chair tiling, the Ammann--Beenker tiling, the rational pinwheel tiling and the pinwheel tiling.


title: Quantum-secured single-pixel imaging with enhanced security

abstract: In this paper, we propose a novel quantum-secured single-pixel imaging method that utilizes non-classical correlations of a photon pair. Our method can detect any attempts to deceive it by exploiting a non-classical correlation of photon pairs while rejecting strong chaotic light illumination through photon heralding. A security analysis based on polarization-correlation has been conducted, demonstrating that our method has improved security compared to existing quantum-secured imaging. More specifically, a partial deceiving attack, which sends a mixture of a true and a false signal, can be detected with our proposed analysis, while currently employed methods cannot. We also provide proof-of-principle demonstrations of our method and trustworthy images reconstructed using our security analysis. Our method can be developed using matured techniques used in quantum secure communication, thus offering a promising direction for practical applications in secure imaging.


title: On locally analytic vectors of the completed cohomology of modular curves II

abstract: This is a continuation of our previous work on the locally analytic vectors of the completed cohomology of modular curves. We construct differential operators on modular curves with infinite level at p in both "holomorphic" and "anti-holomorphic" directions. As applications, we reprove a classicality result of Emerton which says that every absolutely irreducible two dimensional Galois representation which is regular de Rham at p and appears in the completed cohomology of modular curves comes from an eigenform. Moreover we give a geometric description of the locally analytic representations of $\mathrm{GL}_2(\mathbb{Q}_p)$ attached to such a Galois representation in the completed cohomology.


title: A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms

abstract: Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from using traditional methods to infer potential causal structures from observational data to the field of pattern recognition involved in deep learning. The rapid accumulation of massive data promotes the emergence of causal search methods with brilliant scalability. Existing summaries of causal discovery methods mainly focus on traditional methods based on constraints, scores and FCMs, there is a lack of perfect sorting and elaboration for deep learning-based methods, also lacking some considers and exploration of causal discovery methods from the perspective of variable paradigms. Therefore, we divide the possible causal discovery tasks into three types according to the variable paradigm and give the definitions of the three tasks respectively, define and instantiate the relevant datasets for each task and the final causal model constructed at the same time, then reviews the main existing causal discovery methods for different tasks. Finally, we propose some roadmaps from different perspectives for the current research gaps in the field of causal discovery and point out future research directions.


title: A multi-fragment real-time extension of projected density matrix embedding theory: Non-equilibrium electron dynamics in extended systems

abstract: In this work, we derive a multi-fragment real-time extension of projected density matrix embedding theory (pDMET) designed to treat non-equilibrium electron dynamics in strongly correlated systems. As in the previously developed static pDMET, real-time pDMET partitions the total system into many fragments; the coupling between each fragment and the rest of the system is treated through a compact representation of the environment in terms of a quantum bath. Real-time pDMET involves simultaneously propagating the wavefunctions for each separate fragment-bath embedding system along with an auxiliary mean-field wavefunction of the total system. The equations of motion are derived by (i) projecting the time-dependent Schrodinger equation in the fragment and bath space associated with each separate fragment and by (ii) enforcing the pDMET matching conditions between the global 1-particle reduced density matrix (1-RDM) obtained from the fragment calculations and the mean-field 1-RDM at all points in time. The accuracy of the method is benchmarked through comparisons to the time-dependent density-matrix renormalization group (TD-DMRG) and time-dependent Hartree-Fock (TDHF) theory; the methods were applied to a single-impurity Anderson model and multi-impurity Anderson models with ordered and disordered distributions of the impurities. The results demonstrate a large improvement over TDHF and rapid convergence to the exact dynamics with an increase in fragment size. Our results demonstrate that real-time pDMET is a promising and flexible method to simulate non-equilibrium electron dynamics in heterogeneous systems of large size.


title: Data-Driven Machine Learning Models for a Multi-Objective Flapping Fin Unmanned Underwater Vehicle Control System

abstract: Flapping-fin unmanned underwater vehicle (UUV) propulsion systems provide high maneuverability for naval tasks such as surveillance and terrain exploration. Recent work has explored the use of time-series neural network surrogate models to predict thrust from vehicle design and fin kinematics. We develop a search-based inverse model that leverages a kinematics-to-thrust neural network model for control system design. Our inverse model finds a set of fin kinematics with the multi-objective goal of reaching a target thrust and creating a smooth kinematic transition between flapping cycles. We demonstrate how a control system integrating this inverse model can make online, cycle-to-cycle adjustments to prioritize different system objectives.


title: Feasibility Study of Hybrid Inverse Planning with Transmission Beams and Single-energy Spread-out Bragg Peaks for Proton Flash Radiotherapy

abstract: Ultra-high dose rate (FLASH) proton planning with only transmission beams (TBs) has limitations in normal tissue sparing. The single-energy spread-out Bragg peaks (SESOBPs) of FLASH dose rate have been demonstrated feasible for proton FLASH planning. A hybrid inverse optimization method was developed to combine the TBs and SESOBPs (TB-SESOBP) for FLASH planning. The SESOBPs were generated from spreading out the BPs by pre-designed general bar ridge filters and placed at the central target by range shifters to obtain a uniform dose within the target. The SESOBPs and TBs were fully sampled field-by-field allowing automatic spot selection and weighting in the optimization process. The TB-SESOBP plans were validated in comparison with the TB only (TB-only) plans and the plans with the combination of TBs and BPs (TB-BP) regarding 3D dose and dose rate distributions for five lung cases. Comparing to the TB-only plans, the mean spinal cord D1.2cc drastically reduced 41%, the mean lung V7Gy and V7.4Gy moderately reduced by up to 17% and the target dose homogeneity slightly increased in the TB-SESOBP plans. Comparable dose homogeneity was achieved in both TB-SESOBP and TB-BP plans. Besides, prominent improvements were achieved in lung sparing for the cases of relatively large targets by the TB-SESOBP plans comparing to the TB-BP plans. The targets were fully covered with the FLASH dose rate in all the three plans. For the OARs, V40Gy/s = 100% was achieved by the TB-only plans while V40Gy/s > 85% was obtained by the other two plans. We have demonstrated that the hybrid TB-SESOBP planning was feasible to achieve FLASH dose rate for proton therapy. The hybrid TB-SESOBP planning has great potential in improving OAR sparing while maintaining high target dose homogeneity, and can be potentially implemented for adaptive radiotherapy.


title: Optimal semiclassical spectral asymptotics for differential operators with non-smooth coefficients

abstract: We consider differential operators defined as Friedrichs extensions of quadratic forms with non-smooth coefficients. We prove a two term optimal asymptotic for the Riesz means of these operators and thereby also reprove an optimal Weyl law under certain regularity conditions. The methods used are then extended to consider more general admissible operators perturbed by a rough differential operator and obtaining optimal spectral asymptotics again under certain regularity conditions. For the Weyl law we assume the coefficients are differentiable with H\"older continuous derivatives and for the Riesz means we assume the coefficients are two times differentiable with H\"older continuous derivatives.


title: High-speed scanless entire bandwidth mid-infrared chemical imaging

abstract: Mid-infrared spectroscopy probes molecular vibrations to identify chemical species and functional groups. Therefore, mid-infrared hyperspectral imaging is one of the most powerful and promising candidates for chemical imaging using optical methods. Yet high-speed and entire bandwidth mid-infrared hyperspectral imaging has not been realized. Here we report a mid-infrared hyperspectral chemical imaging technique that uses chirped pulse upconversion of sub-cycle pulses at the image plane. This technique offers a lateral resolution of 15 $\mu$m, and the field of view is adjustable between 800 $\mu$m $\times$ 600 $\mu$m to 12 mm $\times$ 9 mm. The hyperspectral imaging produces a 640 $\times$ 480 pixel image in 8 s, which covers a spectral range of 640-3015 cm$^{-1}$, comprising 1069 wavelength points and offering a wavenumber resolution of 2.6-3.7 cm$^{-1}$. For discrete frequency mid-infrared imaging, the measurement speed reaches a frame rate of 5 kHz, the repetition rate of the laser. As a demonstration, we effectively identified and mapped different components in a microfluidic device, plant cell, and mouse embryo section. The great capacity and latent force of this technique in chemical imaging promise to be applied to many fields such as chemical analysis, biology, and medicine.


title: SEEK: model extraction attack against hybrid secure inference protocols

abstract: Security concerns about a machine learning model used in a prediction-as-a-service include the privacy of the model, the query and the result. Secure inference solutions based on homomorphic encryption (HE) and/or multiparty computation (MPC) have been developed to protect all the sensitive information. One of the most efficient type of solution utilizes HE for linear layers, and MPC for non-linear layers. However, for such hybrid protocols with semi-honest security, an adversary can malleate the intermediate features in the inference process, and extract model information more effectively than methods against inference service in plaintext. In this paper, we propose SEEK, a general extraction method for hybrid secure inference services outputing only class labels. This method can extract each layer of the target model independently, and is not affected by the depth of the model. For ResNet-18, SEEK can extract a parameter with less than 50 queries on average, with average error less than $0.03\%$.


title: Algorithmic (Semi-)Conjugacy via Koopman Operator Theory

abstract: Iterative algorithms are of utmost importance in decision and control. With an ever growing number of algorithms being developed, distributed, and proprietarized, there is a similarly growing need for methods that can provide classification and comparison. By viewing iterative algorithms as discrete-time dynamical systems, we leverage Koopman operator theory to identify (semi-)conjugacies between algorithms using their spectral properties. This provides a general framework with which to classify and compare algorithms.


title: Self-Supervised Clustering on Image-Subtracted Data with Deep-Embedded Self-Organizing Map

abstract: Developing an effective automatic classifier to separate genuine sources from artifacts is essential for transient follow-ups in wide-field optical surveys. The identification of transient detections from the subtraction artifacts after the image differencing process is a key step in such classifiers, known as real-bogus classification problem. We apply a self-supervised machine learning model, the deep-embedded self-organizing map (DESOM) to this "real-bogus" classification problem. DESOM combines an autoencoder and a self-organizing map to perform clustering in order to distinguish between real and bogus detections, based on their dimensionality-reduced representations. We use 32x32 normalized detection thumbnails as the input of DESOM. We demonstrate different model training approaches, and find that our best DESOM classifier shows a missed detection rate of 6.6% with a false positive rate of 1.5%. DESOM offers a more nuanced way to fine-tune the decision boundary identifying likely real detections when used in combination with other types of classifiers, for example built on neural networks or decision trees. We also discuss other potential usages of DESOM and its limitations.


title: iSimLoc: Visual Global Localization for Previously Unseen Environments with Simulated Images

abstract: The visual camera is an attractive device in beyond visual line of sight (B-VLOS) drone operation, since they are low in size, weight, power, and cost, and can provide redundant modality to GPS failures. However, state-of-the-art visual localization algorithms are unable to match visual data that have a significantly different appearance due to illuminations or viewpoints. This paper presents iSimLoc, a condition/viewpoint consistent hierarchical global re-localization approach. The place features of iSimLoc can be utilized to search target images under changing appearances and viewpoints. Additionally, our hierarchical global re-localization module refines in a coarse-to-fine manner, allowing iSimLoc to perform a fast and accurate estimation. We evaluate our method on one dataset with appearance variations and one dataset that focuses on demonstrating large-scale matching over a long flight in complicated environments. On our two datasets, iSimLoc achieves 88.7\% and 83.8\% successful retrieval rates with 1.5s inferencing time, compared to 45.8% and 39.7% using the next best method. These results demonstrate robust localization in a range of environments.


title: Implementation of an Energy Management System for Real-Time Power Flow Control in AC Microgrid

abstract: Microgrid (MG) system, which is composed of renewable resources with the utility grid, energy storage unit, electric vehicles, and loads, acts as a single controllable entity. To get efficient and low-cost energy, need to manage power flow within MG depending on renewable resources and load demand. This paper proposes an energy management system (EMS) for grid-connected photovoltaic (PV) and energy storage system (ESS) based on AC MG. The proposed EMS regulates power flow through the AC bus considering next-day solar irradiance prediction, tariff profile, and day-ahead load demand to minimize the cost of electricity. The recommended EMS for the MG system has been verified using MATLAB/Simulink. Also, the algorithm has been tasted with real time data of a 10kW PV system.


title: RMExplorer: A Visual Analytics Approach to Explore the Performance and the Fairness of Disease Risk Models on Population Subgroups

abstract: Disease risk models can identify high-risk patients and help clinicians provide more personalized care. However, risk models developed on one dataset may not generalize across diverse subpopulations of patients in different datasets and may have unexpected performance. It is challenging for clinical researchers to inspect risk models across different subgroups without any tools. Therefore, we developed an interactive visualization system called RMExplorer (Risk Model Explorer) to enable interactive risk model assessment. Specifically, the system allows users to define subgroups of patients by selecting clinical, demographic, or other characteristics, to explore the performance and fairness of risk models on the subgroups, and to understand the feature contributions to risk scores. To demonstrate the usefulness of the tool, we conduct a case study, where we use RMExplorer to explore three atrial fibrillation risk models by applying them to the UK Biobank dataset of 445,329 individuals. RMExplorer can help researchers to evaluate the performance and biases of risk models on subpopulations of interest in their data.


title: Some criteria for integer sequences pair being realizable by a graph

abstract: Let $A=(a_1,\ldots,a_n)$ and $B=(b_1,\ldots,b_n)$ be two sequences of nonnegative integers with $a_i \le b_i$ for $1\le i\le n$. The pair $(A;B)$ is said to be realizable by a graph if there exists a simple graph $G$ with vertices $v_1,\ldots, v_n$ such that $a_i\le d_G(v_i)\le b_i$ for $1\le i\le n$. Let $\preceq$ denote the lexicographic ordering on $Z\times Z:$ $(a_{i+1},b_{i+1})\preceq (a_i,b_i)\Longleftrightarrow [(a_{i+1}<a_i)\vee ((a_{i+1}=a_i)\&(b_{i+1}\le b_i))]$. We say that the sequences $A$ and $B$ are in good order if $(a_{i+1},b_{i+1})\preceq (a_i,b_i)$. In this paper, we consider the generalizations of six classical characterizations on sequences pair due to Berge, Ryser et al. and present related results.


title: Full investigation of nonadiabatic dynamical characterization in arbitrary quenching process

abstract: Recently, dynamical characterization of bulk topology has been experimentally realized under nonadiabatic sudden quench dynamics. However, it has been shown that only the topology of final phase can be characterized when the system is quenched from initial topologically trivial phase. In this paper, taking the two-dimensional Chern insulator as an example, we make a thorough investigation of different types of quenching processes under nonadiabatic slow quench dynamics, and study not only the processes between nontrivial phase and trivial phase, but also between the phases with different topological invariants. We find that, under slow quench dynamics, both the initial and final topological phase can be characterized and the topological invariant can be captured by time-averaged spin polarization. Moreover, different types of processes can be distinguished from the special regions where the time-averaged spin polarization vanishes. All the dynamical characterization schemes are entirely based on the experimentally measurable quantity time-averaged spin polarization, and thus one can expect our findings may provide reference for future experiments.


title: GES Model :Combining Pearson Correlation Coefficient Analysis with Multilayer Perceptron

abstract: With the development of technological progress, mining on asteroids is becoming a reality. This paper focuses on how to distribute asteroid mineral resources in a reasonable way to ensure global equity. To distribute asteroid resources fairly, 7 primary indicators and 20 secondary indicators are introduced to build a mathematical model to evaluate global equity and the weights are given by Analytic Hierarchy Process (AHP). Then Global Equity Score(GES) Model based on 12 primary indicators and 40 secondary indicators is built and TOPSIS method is applied to rank all countries. A t-distribution probability density function is applied to simulate the rate of asteroid mining. The Backward Algorithm is applied to quantitatively measure the impact of changing indicators on global equity. Then Pearson correlation coefficient analysis is conducted for each indicator, and t-test is performed lastly. The results demonstrate that asteroid mining promotes global equity that poor countries can be allocated slightly more mineral resources, and a schedule of the implementation of each measure is given. To gain more insight, sensitivity analysis is conducted and the results demonstrate that scores vary less than 7%. It can be concluded that our GES model have great potential as its robustness, accuracy and strengths.


title: Cone and contraction theorem for projective morphisms between complex analytic spaces

abstract: We discuss the cone and contraction theorem in a suitable complex analytic setting. More precisely, we establish the cone and contraction theorem of normal pairs for projective morphisms between complex analytic spaces. This result is a starting point of the minimal model program for complex analytic log canonical pairs. In this paper, we are mainly interested in normal pairs whose singularities are worse than kawamata log terminal singularities.


title: Analysis of Quantization on MLP-based Vision Models

abstract: Quantization is wildly taken as a model compression technique, which obtains efficient models by converting floating-point weights and activations in the neural network into lower-bit integers. Quantization has been proven to work well on convolutional neural networks and transformer-based models. Despite the decency of these models, recent works have shown that MLP-based models are able to achieve comparable results on various tasks ranging from computer vision, NLP to 3D point cloud, while achieving higher throughput due to the parallelism and network simplicity. However, as we show in the paper, directly applying quantization to MLP-based models will lead to significant accuracy degradation. Based on our analysis, two major issues account for the accuracy gap: 1) the range of activations in MLP-based models can be too large to quantize, and 2) specific components in the MLP-based models are sensitive to quantization. Consequently, we propose to 1) apply LayerNorm to control the quantization range of activations, 2) utilize bounded activation functions, 3) apply percentile quantization on activations, 4) use our improved module named multiple token-mixing MLPs, and 5) apply linear asymmetric quantizer for sensitive operations. Equipped with the abovementioned techniques, our Q-MLP models can achieve 79.68% accuracy on ImageNet with 8-bit uniform quantization (model size 30 MB) and 78.47% with 4-bit quantization (15 MB).


title: Open Source Horizontal IoT Platforms: A Comparative Study on Functional Requirements

abstract: The growth in the deployment of Internet of Things (IoT) devices in various industries required the use of IoT platforms to manage, automate and control devices. This introduced different commercial and open source IoT platforms for developers and researchers to deploy. As a result, selecting one of these platforms for a specific application and use case became a challenge. In this study, a guideline for selecting an open source platform is presented. The process starts by identifying a list of functional requirements that would reflect the requirements of an IoT system in general. This list of requirements is used to compare between four major open source platforms: 1) OM2M (OneM2M standard), 2) IoTivity (OCF standard), LwM2M (OMA SpecWorks LwM2M standard), and 4) FIWARE (FIWARE standard). The purpose of this comparison is to indicate the capability and limitations of the different platforms and how they satisfy each requirement. Afterwards, two examples are presented to demonstrate how this guideline is used to select the most suitable platform for an e-health and a smart city use case. This includes how to define each use case and all the required information that could affect the process of selecting the most suitable platform for the development of the IoT platform.


title: Spline-Like Wavelet Filterbanks with Perfect Reconstruction on Arbitrary Graphs

abstract: In this work, we propose a class of spline-like wavelet filterbanks for graph signals. These filterbanks possess the properties of critical sampling and perfect reconstruction. Besides, the analysis filters are localized in the graph domain because they are polynomials of the normalized adjacency matrix of the graph. We generalize the spline-like filters in the literature so that they have the ability to annihilate signals of some specified frequencies. Optimization problems are posed for the analysis filters to approximate desired responses. We conduct some experiments to demonstrate the good locality of the proposed filters and the good performance of the filterbank in the denoising task.


title: Dynamics, interference effects, and multistability in a Lorenz-like system of a classical wave-particle entity in a periodic potential

abstract: A classical wave-particle entity (WPE) can be realized experimentally as a droplet walking on the free surface of a vertically vibrating liquid bath, with the droplet's horizontal walking motion guided by its self-generated wave field. These self-propelled WPEs have been shown to exhibit analogs of several quantum and optical phenomena. Using an idealized theoretical model that takes the form of a Lorenz-like system, we theoretically and numerically explore the dynamics of such a one-dimensional WPE in a sinusoidal potential. We find steady states of the system that correspond to a stationary WPE as well as a rich array of unsteady motions such as back-and-forth oscillating walkers, runaway oscillating walkers and various types of irregular walkers. In the parameter space formed by the dimensionless parameters of the applied sinusoidal potential, we observe patterns of alternating unsteady behaviors suggesting interference effects. Additionally, in certain regions of the parameter space, we also identify multistability in the particle's long-term behavior that depends on the initial conditions. We make analogies between the identified behaviors in the WPE system and Bragg's reflection of light as well as electron motion in crystals.


title: Landau distribution of ionization losses: history, importance, extensions

abstract: The ionization losses -- the losses of energy by fast charged particles traveling through a matter -- have been under study for more than 100 years. The theoretical explanation of this process spans similar period. About 75 years ago, Lev Landau published a theoretical paper on the ionization losses, which drastically leveled up the research and still remains amongst the most cited in the field. The present note digests the history of theoretical development and attempts to clarify Landau's method of research and the function named after him.


title: TSFool: Crafting Highly-Imperceptible Adversarial Time Series through Multi-Objective Attack

abstract: Recent years have witnessed the success of recurrent neural network (RNN) models in time series classification (TSC). However, neural networks (NNs) are vulnerable to adversarial samples, which cause real-life adversarial attacks that undermine the robustness of AI models. To date, most existing attacks target at feed-forward NNs and image recognition tasks, but they cannot perform well on RNN-based TSC. This is due to the cyclical computation of RNN, which prevents direct model differentiation. In addition, the high visual sensitivity of time series to perturbations also poses challenges to local objective optimization of adversarial samples. In this paper, we propose an efficient method called TSFool to craft highly-imperceptible adversarial time series for RNN-based TSC. The core idea is a new global optimization objective known as "Camouflage Coefficient" that captures the imperceptibility of adversarial samples from the class distribution. Based on this, we reduce the adversarial attack problem to a multi-objective optimization problem that enhances the perturbation quality. Furthermore, to speed up the optimization process, we propose to use a representation model for RNN to capture deeply embedded vulnerable samples whose features deviate from the latent manifold. Experiments on 11 UCR and UEA datasets showcase that TSFool significantly outperforms six white-box and three black-box benchmark attacks in terms of effectiveness, efficiency and imperceptibility from various perspectives including standard measure, human study and real-world defense.


title: Jointly Contrastive Representation Learning on Road Network and Trajectory

abstract: Road network and trajectory representation learning are essential for traffic systems since the learned representation can be directly used in various downstream tasks (e.g., traffic speed inference, and travel time estimation). However, most existing methods only contrast within the same scale, i.e., treating road network and trajectory separately, which ignores valuable inter-relations. In this paper, we aim to propose a unified framework that jointly learns the road network and trajectory representations end-to-end. We design domain-specific augmentations for road-road contrast and trajectory-trajectory contrast separately, i.e., road segment with its contextual neighbors and trajectory with its detour replaced and dropped alternatives, respectively. On top of that, we further introduce the road-trajectory cross-scale contrast to bridge the two scales by maximizing the total mutual information. Unlike the existing cross-scale contrastive learning methods on graphs that only contrast a graph and its belonging nodes, the contrast between road segment and trajectory is elaborately tailored via novel positive sampling and adaptive weighting strategies. We conduct prudent experiments based on two real-world datasets with four downstream tasks, demonstrating improved performance and effectiveness. The code is available at https://github.com/mzy94/JCLRNT.


title: Multi-Active Multi-Passive (MAMP)-IRS Aided Wireless Communication: A Multi-Hop Beam Routing Design

abstract: Prior studies on intelligent reflecting surface (IRS) have mostly considered wireless communication systems aided by a single passive IRS, which, however, has limited control over wireless propagation environment and suffers severe product-distance path-loss. To address these issues, we propose in this paper a new multi-active multi-passive (MAMP)-IRS aided wireless communication system, where a number of active and passive IRSs are deployed to assist the downlink communication in complex environment, by establishing a multi-hop reflection path across active and passive IRSs. An optimization problem is formulated to maximize the achievable rate of a typical user by designing the active-and-passive IRS routing path as well as the joint beamforming of the BS and selected active/passive IRSs. To draw useful insights into the optimal design, we first consider a special case of the single-active multi-passive (SAMP)-IRS aided system. For this case, we propose an efficient algorithm to obtain its optimal solution by first optimizing the joint beamforming given any SAMP-IRS routing path, and then optimizing the routing path by using a new path decomposition method and graph theory. Next, for the general MAMP-IRS aided system, we show that its challenging beam routing optimization problem can be efficiently solved by a new two-phase approach. Its key idea is to first optimize the inner passive-IRS beam routing between each two active IRSs for effective channel power gain maximization, followed by an outer active-IRS beam routing optimization for rate maximization. Last, numerical results are provided to demonstrate the effectiveness of the proposed MAMP-IRS beam routing scheme.


title: Distributed Algorithm for Continuous-type Bayesian Nash Equilibrium in Subnetwork Zero-sum Games

abstract: In this paper, we consider a continuous-type Bayesian Nash equilibrium (BNE) seeking problem in subnetwork zero-sum games, which is a generalization of deterministic subnetwork zero-sum games and discrete-type Bayesian zero-sum games. In this continuous-type model, because the feasible strategy set is composed of infinite-dimensional functions and is not compact, it is hard to seek a BNE in a non-compact set and convey such complex strategies in network communication. To this end, we design two steps to overcome the above bottleneck. One is a discretization step, where we discretize continuous types and prove that the BNE of the discretized model is an approximate BNE of the continuous model with an explicit error bound. The other one is a communication step, where we adopt a novel compression scheme with a designed sparsification rule and prove that agents can obtain unbiased estimations through compressed communication. Based on the above two steps, we propose a distributed communication-efficient algorithm to practicably seek an approximate BNE, and further provide an explicit error bound and an $O(\ln T/\sqrt{T})$ convergence rate.


title: Joint User and Data Detection in Grant-Free NOMA with Attention-based BiLSTM Network

abstract: We consider the multi-user detection (MUD) problem in uplink grant-free non-orthogonal multiple access (NOMA), where the access point has to identify the total number and correct identity of the active Internet of Things (IoT) devices and decode their transmitted data. We assume that IoT devices use complex spreading sequences and transmit information in a random-access manner following the burst-sparsity model, where some IoT devices transmit their data in multiple adjacent time slots with a high probability, while others transmit only once during a frame. Exploiting the temporal correlation, we propose an attention-based bidirectional long short-term memory (BiLSTM) network to solve the MUD problem. The BiLSTM network creates a pattern of the device activation history using forward and reverse pass LSTMs, whereas the attention mechanism provides essential context to the device activation points. By doing so, a hierarchical pathway is followed for detecting active devices in a grant-free scenario. Then, by utilising the complex spreading sequences, blind data detection for the estimated active devices is performed. The proposed framework does not require prior knowledge of device sparsity levels and channels for performing MUD. The results show that the proposed network achieves better performance compared to existing benchmark schemes.


title: Magnetostatic interaction energy between a point magnet and a ring magnet

abstract: We find an exact closed-form expression for the magnetostatic interaction energy between a point magnet and a ring magnet in terms of complete elliptic integrals. The exact expression for the energy exhibits an equilibrium point close to the axis of symmetry of the ring magnet. Our methodology will be useful in investigations concerning magnetic levitation, and in the study of Casimir levitation.


title: Classical Sequence Match is a Competitive Few-Shot One-Class Learner

abstract: Nowadays, transformer-based models gradually become the default choice for artificial intelligence pioneers. The models also show superiority even in the few-shot scenarios. In this paper, we revisit the classical methods and propose a new few-shot alternative. Specifically, we investigate the few-shot one-class problem, which actually takes a known sample as a reference to detect whether an unknown instance belongs to the same class. This problem can be studied from the perspective of sequence match. It is shown that with meta-learning, the classical sequence match method, i.e. Compare-Aggregate, significantly outperforms transformer ones. The classical approach requires much less training cost. Furthermore, we perform an empirical comparison between two kinds of sequence match approaches under simple fine-tuning and meta-learning. Meta-learning causes the transformer models' features to have high-correlation dimensions. The reason is closely related to the number of layers and heads of transformer models. Experimental codes and data are available at https://github.com/hmt2014/FewOne


title: Point Cloud Registration-Driven Robust Feature Matching for 3D Siamese Object Tracking

abstract: Learning robust feature matching between the template and search area is crucial for 3D Siamese tracking. The core of Siamese feature matching is how to assign high feature similarity on the corresponding points between the template and search area for precise object localization. In this paper, we propose a novel point cloud registration-driven Siamese tracking framework, with the intuition that spatially aligned corresponding points (via 3D registration) tend to achieve consistent feature representations. Specifically, our method consists of two modules, including a tracking-specific nonlocal registration module and a registration-aided Sinkhorn template-feature aggregation module. The registration module targets at the precise spatial alignment between the template and search area. The tracking-specific spatial distance constraint is proposed to refine the cross-attention weights in the nonlocal module for discriminative feature learning. Then, we use the weighted SVD to compute the rigid transformation between the template and search area, and align them to achieve the desired spatially aligned corresponding points. For the feature aggregation model, we formulate the feature matching between the transformed template and search area as an optimal transport problem and utilize the Sinkhorn optimization to search for the outlier-robust matching solution. Also, a registration-aided spatial distance map is built to improve the matching robustness in indistinguishable regions (e.g., smooth surface). Finally, guided by the obtained feature matching map, we aggregate the target information from the template into the search area to construct the target-specific feature, which is then fed into a CenterPoint-like detection head for object localization. Extensive experiments on KITTI, NuScenes and Waymo datasets verify the effectiveness of our proposed method.


title: Shubnikov de Haas (SdH) Oscillation in Self-Flux Grown Rhombohedral Single Crystalline Bismuth

abstract: The historic de Haas van Alphen effect observed in the late 1950s in CSIR-NPL by J.S. Dhillon and D. Shoenberg in pure bismuth and zinc metal is revisited in this article hrough a single crystalline phase of bismuth crystal, which is observed in terms of resistivity as predicted by Shubnikov de Haas oscillations. The occurrence of oscillations in the transverse magnetic field confirms the presence of the Fermi surface. The single crystal of bismuth is grown through solid-state reaction under an optimized heat treatment whose purity and structural phase are confirmed through XRD, SEM, and EDAX.


title: Federated Learning based on Defending Against Data Poisoning Attacks in IoT

abstract: The rapidly expanding number of Internet of Things (IoT) devices is generating huge quantities of data, but the data privacy and security exposure in IoT devices, especially in the automatic driving system. Federated learning (FL) is a paradigm that addresses data privacy, security, access rights, and access to heterogeneous message issues by integrating a global model based on distributed nodes. However, data poisoning attacks on FL can undermine the benefits, destroying the global model's availability and disrupting model training. To avoid the above issues, we build up a hierarchical defense data poisoning (HDDP) system framework to defend against data poisoning attacks in FL, which monitors each local model of individual nodes via abnormal detection to remove the malicious clients. Whether the poisoning defense server has a trusted test dataset, we design the \underline{l}ocal \underline{m}odel \underline{t}est \underline{v}oting (LMTV) and \underline{k}ullback-\underline{l}eibler divergence \underline{a}nomaly parameters \underline{d}etection (KLAD) algorithms to defend against label-flipping poisoning attacks. Specifically, the trusted test dataset is utilized to obtain the evaluation results for each classification to recognize the malicious clients in LMTV. More importantly, we adopt the kullback leibler divergence to measure the similarity between local models without the trusted test dataset in KLAD. Finally, through extensive evaluations and against the various label-flipping poisoning attacks, LMTV and KLAD algorithms could achieve the $100\%$ and $40\%$ to $85\%$ successful defense ratios under different detection situations.


title: Initial traces and solvability for a semilinear heat equation on a half space of ${\mathbb R}^N$

abstract: We show the existence and the uniqueness of initial traces of nonnegative solutions to a semilinear heat equation on a half space of ${\mathbb R}^N$ under the zero Dirichlet boundary condition. Furthermore, we obtain necessary conditions and sufficient conditions on the initial data for the solvability of the corresponding Cauchy--Dirichlet problem. Our necessary conditions and sufficient conditions are sharp and enable us to find optimal singularities of initial data for the solvability of the Cauchy--Dirichlet problem.


title: A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends

abstract: Computer vision (CV) is a big and important field in artificial intelligence covering a wide range of applications. Image analysis is a major task in CV aiming to extract, analyse and understand the visual content of images. However, image-related tasks are very challenging due to many factors, e.g., high variations across images, high dimensionality, domain expertise requirement, and image distortions. Evolutionary computation (EC) approaches have been widely used for image analysis with significant achievement. However, there is no comprehensive survey of existing EC approaches to image analysis. To fill this gap, this paper provides a comprehensive survey covering all essential EC approaches to important image analysis tasks including edge detection, image segmentation, image feature analysis, image classification, object detection, and others. This survey aims to provide a better understanding of evolutionary computer vision (ECV) by discussing the contributions of different approaches and exploring how and why EC is used for CV and image analysis. The applications, challenges, issues, and trends associated to this research field are also discussed and summarised to provide further guidelines and opportunities for future research.


title: Kondo scattering in underdoped Nd1-xSrxNiO2 infinite-layer superconducting thin films

abstract: The recent discovery of superconductivity in infinite-layer nickelates generates tremendous research endeavors, but the ground state of their parent compounds is still under debate. Here, we report experimental evidences for the dominant role of Kondo scattering in the underdoped Nd1-xSrxNiO2 thin films. A resistivity minimum associated with logarithmic temperature dependence in both longitudinal and Hall resistivities are observed in the underdoped Nd1-xSrxNiO2 samples before the superconducting transition. A linear scaling behavior $\sigma_{xy}^{AHE}\sim\sigma_{xx}$ between anomalous Hall conductivity $\sigma_{xy}^{AHE}$ and conductivity $\sigma_{xx}$ is revealed, verifying the dominant Kondo scattering at low temperature. The effect of weak (anti-)localization is found to be secondary. Our experiments can help clarifying the basic physics in the underdoped Nd1-xSrxNiO2 infinite-layer thin films.


title: Ryser's Theorem for Symmetric $\rho$-latin Squares

abstract: Let $L$ be an $n\times n$ array whose top left $r\times r$ subarray is filled with $k$ different symbols, each occurring at most once in each row and at most once in each column. We establish necessary and sufficient conditions that ensure the remaining cells of $L$ can be filled such that each symbol occurs at most once in each row and at most once in each column, $L$ is symmetric with respect to the main diagonal, and each symbol occurs a prescribed number of times in $L$. The case where the prescribed number of times each symbol occurs is $n$ was solved by Cruse (J. Combin. Theory Ser. A 16 (1974), 18-22), and the case where the top left subarray is $r\times n$ and the symmetry is not required, was settled by Goldwasser et al. (J. Combin. Theory Ser. A 130 (2015), 26-41). Our result allows the entries of the main diagonal to be specified as well, which leads to an extension of the Andersen-Hoffman's Theorem (Annals of Disc. Math. 15 (1982) 9-26, European J. Combin. 4 (1983) 33-35).


title: Embedding Irregular Colorings into Connected Factorizations

abstract: For $r:=(r_1,\dots,r_k)$, an $r$-factorization of the complete $\lambda$-fold $h$-uniform $n$-vertex hypergraph $\lambda K_n^h$ is a partition of (the edges of) $\lambda K_n^h$ into $F_1,\dots, F_k$ such that for $i=1,\dots,k$, $F_i$ is $r_i$-regular and spanning. Suppose that $n \geq (h-1)(2m-1)$. Given a partial $r$-factorization of $\lambda K_m^h$, that is, a coloring (i.e. partition) $P$ of the edges of $\lambda K_m^h$ into $F_1,\dots, F_k$ such that for $i=1,\dots,k$, $F_i$ is spanning and the degree of each vertex in $F_i$ is at most $r_i$, we find necessary and sufficient conditions that ensure $P$ can be extended to a connected $r$-factorization of $\lambda K_n^h$ (i.e. an $r$-factorization in which each factor is connected). Moreover, we prove a general result that implies the following. Given a partial $s$-factorization $P$ of any sub-hypergraph of $\lambda K_m^h$, where $s:=(s_1,\dots,s_q)$ and $q$ is not too big, we find necessary and sufficient conditions under which $P$ can be embedded into a connected $r$-factorization of $\lambda K_n^h$. These results can be seen as unified generalizations of various classical combinatorial results such as Cruse's theorem on embedding partial symmetric latin squares, Baranyai's theorem on factorization of hypergraphs, Hilton's theorem on extending path decompositions into Hamiltonian decompositions, H\"{a}ggkvist and Hellgren's theorem on extending 1-factorizations, and Hilton, Johnson, Rodger, and Wantland's theorem on embedding connected factorizations.


title: The algebraic and geometric classification of nilpotent Lie triple systems up to dimension four

abstract: In this paper we generalize the Skjelbred Sund method, used to classify nilpotent Lie algebras, in order to classify triple systems with non zero annihilator. We develop this method with the purpose of classifying nilpotent Lie triple systems, obtaining from it the algebraic classification of the nilpotent Lie triple systems up to dimension four. Additionally, we obtain the geometric classification of the variety of nilpotent Lie triple systems up to dimension four.


title: On Layer-Rainbow Latin Cubes Containing Layer-Rainbow Latin Cubes

abstract: Despite the fact that latin cubes have been studied since in the 1940's, there are only a few results on embedding partial latin cubes, and all these results are far from being optimal with respect to the size of the containing cube. For example, the bound of the 1970's result of Cruse that a partial latin cube of order $n$ can be embedded into a latin cube of order $16n^4$, was only improved very recently by Potapov to $n^3$. In this note, we prove the first such optimal result by showing that a layer-rainbow latin cube of order $m$ can be embedded into a layer-rainbow latin cube of order $n$ if and only if $n\geq 2m$. A layer-rainbow latin cube $L$ of order $n$ is an $n\times n\times n$ array filled with $n^2$ symbols such that each layer parallel to each face (obtained by fixing one coordinate) contains every symbol exactly once.


title: Reflectance-Guided, Contrast-Accumulated Histogram Equalization

abstract: Existing image enhancement methods fall short of expectations because with them it is difficult to improve global and local image contrast simultaneously. To address this problem, we propose a histogram equalization-based method that adapts to the data-dependent requirements of brightness enhancement and improves the visibility of details without losing the global contrast. This method incorporates the spatial information provided by image context in density estimation for discriminative histogram equalization. To minimize the adverse effect of non-uniform illumination, we propose defining spatial information on the basis of image reflectance estimated with edge preserving smoothing. Our method works particularly well for determining how the background brightness should be adaptively adjusted and for revealing useful image details hidden in the dark.


title: Reflectance-Oriented Probabilistic Equalization for Image Enhancement

abstract: Despite recent advances in image enhancement, it remains difficult for existing approaches to adaptively improve the brightness and contrast for both low-light and normal-light images. To solve this problem, we propose a novel 2D histogram equalization approach. It assumes intensity occurrence and co-occurrence to be dependent on each other and derives the distribution of intensity occurrence (1D histogram) by marginalizing over the distribution of intensity co-occurrence (2D histogram). This scheme improves global contrast more effectively and reduces noise amplification. The 2D histogram is defined by incorporating the local pixel value differences in image reflectance into the density estimation to alleviate the adverse effects of dark lighting conditions. Over 500 images were used for evaluation, demonstrating the superiority of our approach over existing studies. It can sufficiently improve the brightness of low-light images while avoiding over-enhancement in normal-light images.


title: Viewer-Centred Surface Completion for Unsupervised Domain Adaptation in 3D Object Detection

abstract: Every autonomous driving dataset has a different configuration of sensors, originating from distinct geographic regions and covering various scenarios. As a result, 3D detectors tend to overfit the datasets they are trained on. This causes a drastic decrease in accuracy when the detectors are trained on one dataset and tested on another. We observe that lidar scan pattern differences form a large component of this reduction in performance. We address this in our approach, SEE-VCN, by designing a novel viewer-centred surface completion network (VCN) to complete the surfaces of objects of interest within an unsupervised domain adaptation framework, SEE. With SEE-VCN, we obtain a unified representation of objects across datasets, allowing the network to focus on learning geometry, rather than overfitting on scan patterns. By adopting a domain-invariant representation, SEE-VCN can be classed as a multi-target domain adaptation approach where no annotations or re-training is required to obtain 3D detections for new scan patterns. Through extensive experiments, we show that our approach outperforms previous domain adaptation methods in multiple domain adaptation settings. Our code and data are available at https://github.com/darrenjkt/SEE-VCN.


title: Meta Pattern Concern Score: A Novel Evaluation Measure with Human Values for Multi-classifiers

abstract: While advanced classifiers have been increasingly used in real-world safety-critical applications, how to properly evaluate the black-box models given specific human values remains a concern in the community. Such human values include punishing error cases of different severity in varying degrees and making compromises in general performance to reduce specific dangerous cases. In this paper, we propose a novel evaluation measure named Meta Pattern Concern Score based on the abstract representation of probabilistic prediction and the adjustable threshold for the concession in prediction confidence, to introduce the human values into multi-classifiers. Technically, we learn from the advantages and disadvantages of two kinds of common metrics, namely the confusion matrix-based evaluation measures and the loss values, so that our measure is effective as them even under general tasks, and the cross entropy loss becomes a special case of our measure in the limit. Besides, our measure can also be used to refine the model training by dynamically adjusting the learning rate. The experiments on four kinds of models and six datasets confirm the effectiveness and efficiency of our measure. And a case study shows it can not only find the ideal model reducing 0.53% of dangerous cases by only sacrificing 0.04% of training accuracy, but also refine the learning rate to train a new model averagely outperforming the original one with a 1.62% lower value of itself and 0.36% fewer number of dangerous cases.


title: On the Poisson Equation on a Surface with a boundary condition in co-normal direction

abstract: This paper considers the existence of weak and strong solutions to the Poisson equation on a surface with a boundary condition in co-normal direction. We apply the Lax-Milgram theorem and some properties of $H^1$-functions to show the existence of a unique weak solution to the surface Poisson equation when the exterior force belongs to $L_0^p$-space, where $H^1$- and $L_0^p$- functions are the ones whose value of the integral over the surface equal to zero. Moreover, we prove that the weak solution is a strong $L^p$-solution to the system. As an application, we study the solvability of ${\rm{div}_\Gamma } V = F$. The key idea of constructing a strong $L^p$-solution to the surface Poisson equation with a boundary condition in co-normal direction is to make use of solutions to the surface Poisson equation with a Dirichlet boundary condition.


title: A Universally-Deployable ASR Frontend for Joint Acoustic Echo Cancellation, Speech Enhancement, and Voice Separation

abstract: Recent work has shown that it is possible to train a single model to perform joint acoustic echo cancellation (AEC), speech enhancement, and voice separation, thereby serving as a unified frontend for robust automatic speech recognition (ASR). The joint model uses contextual information, such as a reference of the playback audio, noise context, and speaker embedding. In this work, we propose a number of novel improvements to such a model. First, we improve the architecture of the Cross-Attention Conformer that is used to ingest noise context into the model. Second, we generalize the model to be able to handle varying lengths of noise context. Third, we propose Signal Dropout, a novel strategy that models missing contextual information. In the absence of one or more signals, the proposed model performs nearly as well as task-specific models trained without these signals; and when such signals are present, our system compares well against systems that require all context signals. Over the baseline, the final model retains a relative word error rate reduction of 25.0% on background speech when speaker embedding is absent, and 61.2% on AEC when device playback is absent.


title: Noise2SR: Learning to Denoise from Super-Resolved Single Noisy Fluorescence Image

abstract: Fluorescence microscopy is a key driver to promote discoveries of biomedical research. However, with the limitation of microscope hardware and characteristics of the observed samples, the fluorescence microscopy images are susceptible to noise. Recently, a few self-supervised deep learning (DL) denoising methods have been proposed. However, the training efficiency and denoising performance of existing methods are relatively low in real scene noise removal. To address this issue, this paper proposed self-supervised image denoising method Noise2SR (N2SR) to train a simple and effective image denoising model based on single noisy observation. Our Noise2SR denoising model is designed for training with paired noisy images of different dimensions. Benefiting from this training strategy, Noise2SR is more efficiently self-supervised and able to restore more image details from a single noisy observation. Experimental results of simulated noise and real microscopy noise removal show that Noise2SR outperforms two blind-spot based self-supervised deep learning image denoising methods. We envision that Noise2SR has the potential to improve more other kind of scientific imaging quality.


title: Absolute Stability via Lifting and Interpolation

abstract: We revisit the classical problem of absolute stability; assessing the robust stability of a given linear time-invariant (LTI) plant in feedback with a nonlinearity belonging to some given function class. Standard results typically take the form of sufficient conditions on the LTI plant, the least conservative of which are based on O'Shea--Zames--Falb multipliers. We present an alternative analysis based on lifting and interpolation that directly constructs a Lyapunov function that certifies absolute stability without resorting to frequency-domain inequalities or integral quadratic constraints. In particular, we use linear matrix inequalities to search over Lyapunov functions that are quadratic in the iterates and linear in the corresponding function values of the system in a lifted space. We show that our approach recovers state-of-the-art results on a set of benchmark problems.


title: Continuous longitudinal fetus brain atlas construction via implicit neural representation

abstract: Longitudinal fetal brain atlas is a powerful tool for understanding and characterizing the complex process of fetus brain development. Existing fetus brain atlases are typically constructed by averaged brain images on discrete time points independently over time. Due to the differences in onto-genetic trends among samples at different time points, the resulting atlases suffer from temporal inconsistency, which may lead to estimating error of the brain developmental characteristic parameters along the timeline. To this end, we proposed a multi-stage deep-learning framework to tackle the time inconsistency issue as a 4D (3D brain volume + 1D age) image data denoising task. Using implicit neural representation, we construct a continuous and noise-free longitudinal fetus brain atlas as a function of the 4D spatial-temporal coordinate. Experimental results on two public fetal brain atlases (CRL and FBA-Chinese atlases) show that the proposed method can significantly improve the atlas temporal consistency while maintaining good fetus brain structure representation. In addition, the continuous longitudinal fetus brain atlases can also be extensively applied to generate finer 4D atlases in both spatial and temporal resolution.


title: Behavioral Theory for Stochastic Systems? A Data-driven Journey from Willems to Wiener and Back Again

abstract: The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory of stochastic linear systems. We show that series expansions -- in particular Polynomial Chaos Expansions (PCE) of $L^2$-random variables, which date back to Norbert Wiener's seminal work -- enable equivalent behavioral characterizations of linear stochastic systems. Specifically, we prove that under mild assumptions the behavior of the dynamics of the $L^2$-random variables is equivalent to the behavior of the dynamics of the series expansion coefficients and that it entails the behavior composed of sampled realization trajectories. We also illustrate the short-comings of the behavior associated to the time-evolution of the statistical moments. The paper culminates in the formulation of the stochastic fundamental lemma for linear (descriptor) systems, which in turn enables numerically tractable formulations of data-driven stochastic optimal control combining Hankel matrices in realization data (i.e. in measurements) with PCE concepts.


title: DMCA: Dense Multi-agent Navigation using Attention and Communication

abstract: In decentralized multi-robot navigation, ensuring safe and efficient movement with limited environmental awareness remains a challenge. While robots traditionally navigate based on local observations, this approach falters in complex environments. A possible solution is to enhance understanding of the world through inter-agent communication, but mere information broadcasting falls short in efficiency. In this work, we address this problem by simultaneously learning decentralized multi-robot collision avoidance and selective inter-agent communication. We use a multi-head self-attention mechanism that encodes observable information from neighboring robots into a concise and fixed-length observation vector, thereby handling varying numbers of neighbors. Our method focuses on improving navigation performance through selective communication. We cast the communication selection as a link prediction problem, where the network determines the necessity of establishing a communication link with a specific neighbor based on the observable state information. The communicated information enhances the neighbor's observation and aids in selecting an appropriate navigation plan. By training the network end-to-end, we concurrently learn the optimal weights for the observation encoder, communication selection, and navigation components. We showcase the benefits of our approach by achieving safe and efficient navigation among multiple robots, even in dense and challenging environments. Comparative evaluations against various learning-based and model-based baselines demonstrate our superior navigation performance, resulting in an impressive improvement of up to 24% in success rate within complex evaluation scenarios.


title: ImageArg: A Multi-modal Tweet Dataset for Image Persuasiveness Mining

abstract: The growing interest in developing corpora of persuasive texts has promoted applications in automated systems, e.g., debating and essay scoring systems; however, there is little prior work mining image persuasiveness from an argumentative perspective. To expand persuasiveness mining into a multi-modal realm, we present a multi-modal dataset, ImageArg, consisting of annotations of image persuasiveness in tweets. The annotations are based on a persuasion taxonomy we developed to explore image functionalities and the means of persuasion. We benchmark image persuasiveness tasks on ImageArg using widely-used multi-modal learning methods. The experimental results show that our dataset offers a useful resource for this rich and challenging topic, and there is ample room for modeling improvement.


title: Considering Image Information and Self-similarity: A Compositional Denoising Network

abstract: Recently, convolutional neural networks (CNNs) have been widely used in image denoising. Existing methods benefited from residual learning and achieved high performance. Much research has been paid attention to optimizing the network architecture of CNN but ignored the limitations of residual learning. This paper suggests two limitations of it. One is that residual learning focuses on estimating noise, thus overlooking the image information. The other is that the image self-similarity is not effectively considered. This paper proposes a compositional denoising network (CDN), whose image information path (IIP) and noise estimation path (NEP) will solve the two problems, respectively. IIP is trained by an image-to-image way to extract image information. For NEP, it utilizes the image self-similarity from the perspective of training. This similarity-based training method constrains NEP to output a similar estimated noise distribution for different image patches with a specific kind of noise. Finally, image information and noise distribution information will be comprehensively considered for image denoising. Experiments show that CDN achieves state-of-the-art results in synthetic and real-world image denoising. Our code will be released on https://github.com/JiaHongZ/CDN.


title: Graph Perceiver IO: A General Architecture for Graph Structured Data

abstract: Multimodal machine learning has been widely studied for the development of general intelligence. Recently, the remarkable multimodal algorithms, the Perceiver and Perceiver IO, show competitive results for diverse dataset domains and tasks. However, recent works, Perceiver and Perceiver IO, have focused on heterogeneous modalities, including image, text, and speech, and there are few research works for graph structured datasets. A graph is one of the most generalized dataset structures, and we can represent the other dataset, including images, text, and speech, as graph structured data. A graph has an adjacency matrix different from other dataset domains such as text and image, and it is not trivial to handle the topological information, relational information, and canonical positional information. In this study, we provide a Graph Perceiver IO, the Perceiver IO for the graph structured dataset. We keep the main structure of the Graph Perceiver IO as the Perceiver IO because the Perceiver IO already handles the diverse dataset well, except for the graph structured dataset. The Graph Perceiver IO is a general method, and it can handle diverse datasets such as graph structured data as well as text and images. Comparing the graph neural networks, the Graph Perceiver IO requires a lower complexity, and it can incorporate the local and global information efficiently. We show that Graph Perceiver IO shows competitive results for diverse graph-related tasks, including node classification, graph classification, and link prediction.


title: Frequency Reversal Alamouti Code-Based FBMC with Resilience to Inter-Antenna Frequency Offsets

abstract: Transmit diversity schemes for filter bank multicarrier (FBMC) are known to be challenging. No existing schemes have considered the presence of inter-antenna frequency offset (IAFO), which will result in performance degradation. In this letter, a new transmit scheme based on the frequency reversal Alamouti code (FRAC)-based structure to address the issue of IAFO is proposed and is proven to inherently cancel the inter-antenna inter-carrier interference (ICI) while preserving spatial diversity. Moreover, the proposed FRAC structure is applicable in frequency-selective channels. Numerical results show that the proposed scheme undergoes negligible bit error rate (BER) degradation even with considerable IAFOs.