title: A general family of Plotkin-optimal two-weight codes over $\mathbb{Z}_4$

abstract: We obtain all possible parameters of Plotkin-optimal two-Lee weight projective codes over $\mathbb{Z}_4,$ together with their weight distributions. We show the existence of codes with these parameters as well as their weight distributions by constructing an infinite family of two-weight codes. Previously known codes constructed by Shi et al. (\emph{Des Codes Cryptogr.} {\bf 88}(3):1-13, 2020) can be derived as a special case of our results. We also prove that the Gray image of any Plotkin-optimal two-Lee weight projective codes over $\mathbb{Z}_4$ has the same parameters and weight distribution as some two-weight binary projective codes of type SU1 in the sense of Calderbank and Kantor (\emph{Bull. Lond. Math. Soc.} {\bf 18}:97-122, 1986).


title: Modeling the Role that Habitat Overlap Shape has on the Spread of Brucellosis in the Greater Yellowstone Ecosystem

abstract: Brucellosis is a zoonotic bacterial infectious disease that affects livestock and wildlife. The Greater Yellowstone Ecosystem is the last area in the United States where cattle are regularly infected with brucellosis. Even though livestock are vaccinated, interactions with reservoir species still result in spill-over cases to cattle. The National Academy of Sciences, Engineering, and Medicine has indicated that modeling efforts should focus on the transmission between elk and cattle and should be conducted to better understand the effects of land-use change and landscape configuration on disease risk. This chapter determines how the landscape's configuration, using the shape and amount of habitat overlap between elk and cattle, contributes to cross-species brucellosis transmission, and how land-use change translates to disease prevalence. A mathematical-epidemiological model is combined with landscape ecology metrics to estimate transmission rates between the species and model disease spread. The results of this study can ultimately help stakeholders develop policy for controlling brucellosis transmission between livestock and elk in the Greater Yellowstone Area. In turn, this could lead to less disease prevalence, reduce associated costs, and assist in population management.


title: Enlarging the notion of additivity of resource quantifiers

abstract: Whenever a physical quantity becomes essential to the realization of useful tasks, it is desirable to define proper measures or monotones to quantify it. In quantum mechanics, coherence, entanglement, and Bell nonlocality are examples of such quantities. Given a quantum state $\varrho$ and a quantifier ${\cal E}(\varrho)$, both arbitrary, it is a hard task to determine ${\cal E}(\varrho^{\otimes N})$. However, if the figure of merit $\cal{E}$ turns out to be additive, we simply have ${\cal E}(\varrho^{\otimes N})=N e$, with $e={\cal E}(\varrho)$. In this work we generalize this useful notion through the inner product ${\cal E}(\varrho^{\otimes N}) = \vec{N}\cdot \vec{e}$, where $\vec{e}=({\cal E}(\varrho^{\otimes i_1}), {\cal E}(\varrho^{\otimes i_2}),\dots,{\cal E}(\varrho^{\otimes i_q}) )$ is a vector whose $q$ entries are the figure of merit under study calculated for some numbers of copies smaller than $N$ ($1 \le i_1<i_2<\dots <i_q<N$), where $\vec{N}=(N_{i_1}, N_{i_2}, \dots ,N_{i_q})$, is a string of numbers that depends only on $N$ and on the set of integers $\{ {i_j}\}$. We show that the one shot distillable entanglement of certain spherically symmetric states can be quantitatively approximated by such an augmented additivity.


title: Quantum-inspired permanent identities

abstract: The permanent is pivotal to both complexity theory and combinatorics. In quantum computing, the permanent appears in the expression of output amplitudes of linear optical computations, such as in the Boson Sampling model. Taking advantage of this connection, we give quantum-inspired proofs of many existing as well as new remarkable permanent identities. Most notably, we give a quantum-inspired proof of the MacMahon master theorem as well as proofs for new generalizations of this theorem. Previous proofs of this theorem used completely different ideas. Beyond their purely combinatorial applications, our results demonstrate the classical hardness of exact and approximate sampling of linear optical quantum computations with input cat states.


title: enpheeph: A Fault Injection Framework for Spiking and Compressed Deep Neural Networks

abstract: Research on Deep Neural Networks (DNNs) has focused on improving performance and accuracy for real-world deployments, leading to new models, such as Spiking Neural Networks (SNNs), and optimization techniques, e.g., quantization and pruning for compressed networks. However, the deployment of these innovative models and optimization techniques introduces possible reliability issues, which is a pillar for DNNs to be widely used in safety-critical applications, e.g., autonomous driving. Moreover, scaling technology nodes have the associated risk of multiple faults happening at the same time, a possibility not addressed in state-of-the-art resiliency analyses. Towards better reliability analysis for DNNs, we present enpheeph, a Fault Injection Framework for Spiking and Compressed DNNs. The enpheeph framework enables optimized execution on specialized hardware devices, e.g., GPUs, while providing complete customizability to investigate different fault models, emulating various reliability constraints and use-cases. Hence, the faults can be executed on SNNs as well as compressed networks with minimal-to-none modifications to the underlying code, a feat that is not achievable by other state-of-the-art tools. To evaluate our enpheeph framework, we analyze the resiliency of different DNN and SNN models, with different compression techniques. By injecting a random and increasing number of faults, we show that DNNs can show a reduction in accuracy with a fault rate as low as 7 x 10 ^ (-7) faults per parameter, with an accuracy drop higher than 40%. Run-time overhead when executing enpheeph is less than 20% of the baseline execution time when executing 100 000 faults concurrently, at least 10x lower than state-of-the-art frameworks, making enpheeph future-proof for complex fault injection scenarios. We release enpheeph at https://github.com/Alexei95/enpheeph.


title: PASTA: A Dataset for Modeling Participant States in Narratives

abstract: The events in a narrative are understood as a coherent whole via the underlying states of their participants. Often, these participant states are not explicitly mentioned, instead left to be inferred by the reader. A model that understands narratives should likewise infer these implicit states, and even reason about the impact of changes to these states on the narrative. To facilitate this goal, we introduce a new crowdsourced English-language, Participant States dataset, PASTA. This dataset contains inferable participant states; a counterfactual perturbation to each state; and the changes to the story that would be necessary if the counterfactual were true. We introduce three state-based reasoning tasks that test for the ability to infer when a state is entailed by a story, to revise a story conditioned on a counterfactual state, and to explain the most likely state change given a revised story. Experiments show that today's LLMs can reason about states to some degree, but there is large room for improvement, especially in problems requiring access and ability to reason with diverse types of knowledge (e.g. physical, numerical, factual).


title: Convex duality for stochastic shortest path problems in known and unknown environments

abstract: This paper studies Stochastic Shortest Path (SSP) problems in known and unknown environments from the perspective of convex optimisation. It first recalls results in the known parameter case, and develops understanding through different proofs. It then focuses on the unknown parameter case, where it studies extended value iteration (EVI) operators. This includes the existing operators used in Rosenberg et al. [26] and Tarbouriech et al. [31] based on the l-1 norm and supremum norm, as well as defining EVI operators corresponding to other norms and divergences, such as the KL-divergence. This paper shows in general how the EVI operators relate to convex programs, and the form of their dual, where strong duality is exhibited. This paper then focuses on whether the bounds from finite horizon research of Neu and Pike-Burke [21] can be applied to these extended value iteration operators in the SSP setting. It shows that similar bounds to [21] for these operators exist, however they lead to operators that are not in general monotone and have more complex convergence properties. In a special case we observe oscillating behaviour. This paper generates open questions on how research may progress, with several examples that require further examination.


title: CoNLoCNN: Exploiting Correlation and Non-Uniform Quantization for Energy-Efficient Low-precision Deep Convolutional Neural Networks

abstract: In today's era of smart cyber-physical systems, Deep Neural Networks (DNNs) have become ubiquitous due to their state-of-the-art performance in complex real-world applications. The high computational complexity of these networks, which translates to increased energy consumption, is the foremost obstacle towards deploying large DNNs in resource-constrained systems. Fixed-Point (FP) implementations achieved through post-training quantization are commonly used to curtail the energy consumption of these networks. However, the uniform quantization intervals in FP restrict the bit-width of data structures to large values due to the need to represent most of the numbers with sufficient resolution and avoid high quantization errors. In this paper, we leverage the key insight that (in most of the scenarios) DNN weights and activations are mostly concentrated near zero and only a few of them have large magnitudes. We propose CoNLoCNN, a framework to enable energy-efficient low-precision deep convolutional neural network inference by exploiting: (1) non-uniform quantization of weights enabling simplification of complex multiplication operations; and (2) correlation between activation values enabling partial compensation of quantization errors at low cost without any run-time overheads. To significantly benefit from non-uniform quantization, we also propose a novel data representation format, Encoded Low-Precision Binary Signed Digit, to compress the bit-width of weights while ensuring direct use of the encoded weight for processing using a novel multiply-and-accumulate (MAC) unit design.


title: GitHub Marketplace for Practitioners and Researchers to Date: A Systematic Analysis of the Knowledge Mobilization Gap in Open Source Software Automation

abstract: Marketplaces for distributing software products and services have been getting increasing popularity. GitHub, which is most known for its version control functionality through Git, launched its own marketplace in 2017. GitHub Marketplace hosts third party apps and actions to automate workflows in software teams. Currently, this marketplace hosts 440 Apps and 7,878 Actions across 32 different categories. Overall, 419 Third party developers released their apps on this platform which 111 distinct customers adopted. The popularity and accessibility of GitHub projects have made this platform and the projects hosted on it one of the most frequent subjects for experimentation in the software engineering research. A simple Google Scholar search shows that 24,100 Research papers have discussed GitHub within the Software Engineering field since 2017, but none have looked into the marketplace. The GitHub Marketplace provides a unique source of information on the tools used by the practitioners in the Open Source Software (OSS) ecosystem for automating their project's workflow. In this study, we (i) mine and provide a descriptive overview of the GitHub Marketplace, (ii) perform a systematic mapping of research studies in automation for open source software, and (iii) compare the state of the art with the state of the practice on the automation tools. We conclude the paper by discussing the potential of GitHub Marketplace for knowledge mobilization and collaboration within the field. This is the first study on the GitHub Marketplace in the field.


title: Ordered Orthogonal Array Construction Using LFSR Sequences

abstract: We present a new construction of ordered orthogonal arrays (OOA) of strength $t$ with $(q + 1)t$ columns over a finite field $\mathbb{F}_{q}$ using linear feedback shift register sequences (LFSRs). OOAs are naturally related to $(t, m, s)$-nets, linear codes, and MDS codes. Our construction selects suitable columns from the array formed by all subintervals of length $\frac{q^{t}-1}{q-1}$ of an LFSR sequence generated by a primitive polynomial of degree $t$ over $\mathbb{F}_{q}$. We prove properties about the relative positions of runs in an LFSR which guarantee that the constructed OOA has strength $t$. The set of parameters of our OOAs are the same as the ones given by Rosenbloom and Tsfasman (1997) and Skriganov (2002), but the constructed arrays are different. We experimentally verify that our OOAs are stronger than the Rosenbloom-Tsfasman-Skriganov OOAs in the sense that ours are "closer" to being a "full" orthogonal array. We also discuss how our OOA construction relates to previous techniques to build OOAs from a set of linearly independent vectors over $\mathbb{F}_{q}$, as well as to hypergraph homomorphisms.


title: SCExAO and Keck Direct Imaging Discovery of a Low-Mass Companion Around the Accelerating F5 Star HIP 5319

abstract: We present the direct imaging discovery of a low-mass companion to the nearby accelerating F star, HIP 5319, using SCExAO coupled with the CHARIS, VAMPIRES, and MEC instruments in addition to Keck/NIRC2 imaging. CHARIS $JHK$ (1.1-2.4 $\mu$m) spectroscopic data combined with VAMPIRES 750 nm, MEC $Y$, and NIRC2 $L_{\rm p}$ photometry is best matched by an M3--M7 object with an effective temperature of T=3200 K and surface gravity log($g$)=5.5. Using the relative astrometry for HIP 5319 B from CHARIS and NIRC2 and absolute astrometry for the primary from $Gaia$ and $Hipparcos$ and adopting a log-normal prior assumption for the companion mass, we measure a dynamical mass for HIP 5319 B of $31^{+35}_{-11}M_{\rm J}$, a semimajor axis of $18.6^{+10}_{-4.1}$ au, an inclination of $69.4^{+5.6}_{-15}$ degrees, and an eccentricity of $0.42^{+0.39}_{-0.29}$. However, using an alternate prior for our dynamical model yields a much higher mass of 128$^{+127}_{-88}M_{\rm J}$. Using data taken with the LCOGT NRES instrument we also show that the primary HIP 5319 A is a single star in contrast to previous characterizations of the system as a spectroscopic binary. This work underscores the importance of assumed priors in dynamical models for companions detected with imaging and astrometry and the need to have an updated inventory of system measurements.


title: Functional Rule Extraction Method for Artificial Neural Networks

abstract: The idea I propose in this paper is a method that is based on comprehensive functions for directed and undirected rule extraction from artificial neural network operations. Firstly, I defined comprehensive functions, then constructed a comprehensive multilayer network (denoted as $N$). Each activation function of $N$ is parametrized to a comprehensive function. Following $N$ construction, I extracted rules from the network by observing that the network output depends on probabilities of composite functions that are comprehensive functions. This functional rule extraction method applies to the perceptron and multilayer neural network. For any $N$ model that is trained to predict some outcome given some event, that model behaviour can be expressed â using the functional rule extraction method â as a formal rule or informal rule obeyed by the network to predict that outcome. As example, figure 1 consist of a comprehensive physics function that is parameter for one of the network hidden activation functions. Using the functional rule extraction method, I deduced that the comprehensive multilayer network prediction depends on probability of that physics function and probabilities of other composite comprehensive functions in $N$. Additionally, functional rule extraction method can aid in applied settings for generation of equations of learned phenomena. This generation can be achieved by first training an $N$ model toward predicting outcome of a phenomenon, then extracting the rules and assuming that probability values of the network comprehensive functions are constants. Finally, to simplify the generated equation, comprehensive functions with probability $p = 0$ can be omitted.


title: Moduli of Representations of Skewed-Gentle Algebras

abstract: We prove irreducible components of moduli spaces of semistable representations of skewed-gentle algebras, and more generally, clannish algebras, are isomorphic to products of projective spaces. This is achieved by showing irreducible components of varieties of representations of clannish algebras can be viewed as irreducible components of skewed-gentle algebras, which we show are always normal. The main theorem generalizes an analogous result for moduli of representations of special biserial algebras proven by Carroll-Chindris-Kinser-Weyman.


title: Tai-e: A Static Analysis Framework for Java by Harnessing the Best Designs of Classics

abstract: Static analysis is a mature field with applications to bug detection, security analysis, and code optimization, etc. To facilitate these applications, static analysis frameworks play an essential role by providing a series of fundamental services such as program abstraction, control flow graph construction, and points-to/alias information computation, etc. However, despite impressive progress of static analysis, and this field has seen several popular frameworks in the last decades, it is still not clear how a static analysis framework should be designed in a way that analysis developers could benefit more: for example, what a good IR (for analysis) ought to look like? What functionalities should the module of fundamental analyses provide to ease client analyses? How to develop and integrate new analysis conveniently? How to manage multiple analyses? To answer these questions, in this work, we discuss the design trade-offs for the crucial components of a static analysis framework, and argue for the most appropriate design by following the HBDC (Harnessing the Best Designs of Classics) principle: for each crucial component, we compare the design choices made for it (possibly) by different classic frameworks such as Soot, WALA, SpotBugs and Doop, and choose arguably the best one, but if none is good enough, we then propose a better design. These selected or newly proposed designs finally constitute Tai-e, a new static analysis framework for Java. Specifically, Tai-e is novel in the designs of several aspects like IR, pointer analysis and development of new analyses, etc., leading to an easy-to-learn, easy-to-use and efficient system. To our knowledge, this is the first work that systematically explores the designs and implementations of various static analysis frameworks, and we believe it provides useful materials and viewpoints for building better static analysis infrastructures.


title: Symmetry Regularization and Saturating Nonlinearity for Robust Quantization

abstract: Robust quantization improves the tolerance of networks for various implementations, allowing reliable output in different bit-widths or fragmented low-precision arithmetic. In this work, we perform extensive analyses to identify the sources of quantization error and present three insights to robustify a network against quantization: reduction of error propagation, range clamping for error minimization, and inherited robustness against quantization. Based on these insights, we propose two novel methods called symmetry regularization (SymReg) and saturating nonlinearity (SatNL). Applying the proposed methods during training can enhance the robustness of arbitrary neural networks against quantization on existing post-training quantization (PTQ) and quantization-aware training (QAT) algorithms and enables us to obtain a single weight flexible enough to maintain the output quality under various conditions. We conduct extensive studies on CIFAR and ImageNet datasets and validate the effectiveness of the proposed methods.


title: GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversation

abstract: Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph Neural Networks (GNNs) possess the powerful capacity of relational modeling, they have an inherent advantage in the field of multimodal learning. GNNs leverage the graph constructed from multimodal data to perform intra- and inter-modal information interaction, which effectively facilitates the integration and complementation of multimodal data. In this work, we propose a novel Graph network based Multimodal Fusion Technique (GraphMFT) for emotion recognition in conversation. Multimodal data can be modeled as a graph, where each data object is regarded as a node, and both intra- and inter-modal dependencies existing between data objects can be regarded as edges. GraphMFT utilizes multiple improved graph attention networks to capture intra-modal contextual information and inter-modal complementary information. In addition, the proposed GraphMFT attempts to address the challenges of existing graph-based multimodal conversational emotion recognition models such as MMGCN. Empirical results on two public multimodal datasets reveal that our model outperforms the State-Of-The-Art (SOTA) approaches with the accuracy of 67.90% and 61.30%.


title: A note on the operator window of modulation spaces

abstract: Inspired by a recent article \cite[JFAA, 28(2):1-34, (2022)]{Skrettingland2022JoFAaA}, this paper is devoted to the study of suitable window class in the framework of bounded linear operators on $L^2(\rd)$. We establish a natural and complete characterization for the window class such that the corresponding STFT leads to equivalent norms of modulation spaces. The positive bounded linear operators are also characterized in Cohen's class distributions such that the corresponding quantities form equivalent norms of modulation spaces. As a generalization, we introduce a family of operator classes corresponding to the operator-valued modulation spaces. Some applications of our main theorems to the localization operators are also concerned.


title: Self-mixing interference in a thin-slice solid-state laser with few feedback photons per observation period

abstract: Formation of a peculiar lasing pattern leading to a TEM00-like mode accompanied by a nonzero bright outer-ring emission (namely, a modified TEM00 mode) was observed in a 300-\mu m-thick LiNdP4O12 (LNP) laser with reflective flat end mirrors that was pumped with a laser diode whose focused spot size was larger than the lasing beam spot size determined by the thermal lens effect. The photon lifetimes of the laser oscillations were found to be greatly shortened to \tau_{p} = 6.74 ps as compared with those in pure TEM00 mode operation, while the fluorescence lifetime was \tau = 130 \mu s. The formation of the peculiar transverse mode was theoretically treated in terms of the pump-intensity-dependent thermal lens effect, which yields the lasing beam spot sizes in the resultant optical cavity. In addition, transverse spatial hole burning of population inversions due to the preceding transverse eigenmode intensity and the associated anti-guidance of the pure TEM00 field leading to formation of the TEM00 with an emergent outer ring emission was shown to appear with increasing pump power through the electric lens (i.e., population lens) effect, in which almost all of the population inversion contributes to lasing with a pronounced effective modal gain. Self-mixing laser Doppler velocimetry (LDV) experiments and numerical simulations revealed that spontaneous emission factors in the peculiar mode oscillations were greatly decreased in comparison with those in pure TEM00 mode operation. The present thin-slice solid-state laser possessing a large fluorescence-to-photon lifetime and decreased spontaneous emission factor enabled us to detect LDV signals in the regime of few feedback photons per observation period.


title: Li-Yorke and Expansive Composition Operators on Lorentz Spaces

abstract: In this paper, we investigate Li-Yorke composition operators and some of their variations on Lorentz spaces. Further, we also study expansive composition operators on these spaces. The work of the paper is essentially based on the work in [1], [9], [11], and [13].


title: Electromagnetic Signal Injection Attacks on Differential Signaling

abstract: Differential signaling is a method of data transmission that uses two complementary electrical signals to encode information. This allows a receiver to reject any noise by looking at the difference between the two signals, assuming the noise affects both signals in the same way. Many protocols such as USB, Ethernet, and HDMI use differential signaling to achieve a robust communication channel in a noisy environment. This generally works well and has led many to believe that it is infeasible to remotely inject attacking signals into such a differential pair. In this paper we challenge this assumption and show that an adversary can in fact inject malicious signals from a distance, purely using common-mode injection, i.e., injecting into both wires at the same time. We show how this allows an attacker to inject bits or even arbitrary messages into a communication line. Such an attack is a significant threat to many applications, from home security and privacy to automotive systems, critical infrastructure, or implantable medical devices; in which incorrect data or unauthorized control could cause significant damage, or even fatal accidents. We show in detail the principles of how an electromagnetic signal can bypass the noise rejection of differential signaling, and eventually result in incorrect bits in the receiver. We show how an attacker can exploit this to achieve a successful injection of an arbitrary bit, and we analyze the success rate of injecting longer arbitrary messages. We demonstrate the attack on a real system and show that the success rate can reach as high as $90\%$. Finally, we present a case study where we wirelessly inject a message into a Controller Area Network (CAN) bus, which is a differential signaling bus protocol used in many critical applications, including the automotive and aviation sector.


title: Towards Intercultural Affect Recognition: Audio-Visual Affect Recognition in the Wild Across Six Cultures

abstract: In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without annotated affect datasets available for training models. A standard assumption in affective computing is that affect recognition models trained and used within the same culture (intracultural) will perform better than models trained on one culture and used on different cultures (intercultural). We test this assumption and present the first systematic study of intercultural affect recognition models using videos of real-world dyadic interactions from six cultures. We develop an attention-based feature selection approach under temporal causal discovery to identify behavioral cues that can be leveraged in intercultural affect recognition models. Across all six cultures, our findings demonstrate that intercultural affect recognition models were as effective or more effective than intracultural models. We identify and contribute useful behavioral features for intercultural affect recognition; facial features from the visual modality were more useful than the audio modality in this study's context. Our paper presents a proof-of-concept and motivation for the future development of intercultural affect recognition systems, especially those deployed in low-resource situations without annotated data.


title: Solving sparse separable bilinear programs using lifted bilinear cover inequalities

abstract: Recently, we proposed a class of inequalities called lifted bilinear cover inequalities, which are second-order cone representable convex inequalities, and are valid for a set described by a separable bilinear constraint together with bounds on variables. In this paper, we study the computational potential of these inequalities for separable bilinear optimization problems. We first prove that the semi-definite programming relaxation provides no benefit over the McCormick relaxation for such problems. We then design a simple randomized separation heuristic for lifted bilinear cover inequalities. In our computational experiments, we separate many rounds of these inequalities starting from McCormick's relaxation of instances where each constraint is a separable bilinear constraint set. We demonstrate that there is a significant improvement in the performance of a state-of-the-art global solver in terms of gap closed, when these inequalities are added at the root node compared to when they are not.


title: Improving Distantly Supervised Relation Extraction by Natural Language Inference

abstract: To reduce human annotations for relation extraction (RE) tasks, distantly supervised approaches have been proposed, while struggling with low performance. In this work, we propose a novel DSRE-NLI framework, which considers both distant supervision from existing knowledge bases and indirect supervision from pretrained language models for other tasks. DSRE-NLI energizes an off-the-shelf natural language inference (NLI) engine with a semi-automatic relation verbalization (SARV) mechanism to provide indirect supervision and further consolidates the distant annotations to benefit multi-classification RE models. The NLI-based indirect supervision acquires only one relation verbalization template from humans as a semantically general template for each relationship, and then the template set is enriched by high-quality textual patterns automatically mined from the distantly annotated corpus. With two simple and effective data consolidation strategies, the quality of training data is substantially improved. Extensive experiments demonstrate that the proposed framework significantly improves the SOTA performance (up to 7.73\% of F1) on distantly supervised RE benchmark datasets.


title: Linear quadratic leader-follower stochastic differential games for mean-field switching diffusions

abstract: In this paper, we consider a linear quadratic (LQ) leader-follower stochastic differential game for regime switching diffusions with mean-field interactions. One of the salient features of this paper is that conditional mean-field terms are included in the state equation and cost functionals. Based on stochastic maximum principles (SMPs), the follower's problem and the leader's problem are solved sequentially and an open-loop Stackelberg equilibrium is obtained. Further, with the help of the so-called four-step scheme, the corresponding Hamiltonian systems for the two players are decoupled and then the open-loop Stackelberg equilibrium admits a state feedback representation if some new-type Riccati equations are solvable.


title: Random Networks with Heterogeneous Reciprocity

abstract: Users of social networks display diversified behavior and online habits. For instance, a user's tendency to reply to a post can depend on the user and the person posting. For convenience, we group users into aggregated behavioral patterns, focusing here on the tendency to reply to or reciprocate messages. The reciprocity feature in social networks reflects the information exchange among users. We study the properties of a preferential attachment model with heterogeneous reciprocity levels, give the growth rate of model edge counts, and prove convergence of empirical degree frequencies to a limiting distribution. This limiting distribution is not only multivariate regularly varying, but also has the property of hidden regular variation.


title: What Do Deep Neural Networks Find in Disordered Structures of Glasses?

abstract: Glass transitions are widely observed in various types of soft matter systems. However, the physical mechanism of these transitions remains {elusive}, despite years of ambitious research. In particular, an important unanswered question is whether the glass transition is accompanied by a divergence of the correlation lengths of the characteristic static structures. In this study, we develop a deep-neural-network-based method that is used to extract the characteristic local meso-structures solely from instantaneous {particle} configurations without any {information} about the dynamics. We first train a neural network to classify configurations of liquids and glasses correctly. Then, we obtain the characteristic structures by quantifying the grounds for the decisions made by the network using Gradient-weighted Class Activation Mapping (Grad-CAM). We considered two qualitatively different glass-forming binary systems, and through comparisons with several established structural indicators, we demonstrate that our system can be used to identify characteristic structures that depend on the details of the systems. Moreover, the extracted structures are remarkably correlated with the nonequilibrium aging dynamics in thermal fluctuations.

categories: cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.soft cond-mat.stat-mech cs.LG


title: The Effect of Charge Discretization on the Electrical Field inside a Conductor

abstract: We show how the electrical field inside the conductor changes as a function of the number of charged-particles. We show that the non-vanishing electrical field is concentrated near the surface of the conductor, at a shallow depth on the same order of magnitude as the separation between charges. Our study has illustrated the effect of charge discretization on a fundamental emergent law of electrostatics.


title: Chinese grammatical error correction based on knowledge distillation

abstract: In view of the poor robustness of existing Chinese grammatical error correction models on attack test sets and large model parameters, this paper uses the method of knowledge distillation to compress model parameters and improve the anti-attack ability of the model. In terms of data, the attack test set is constructed by integrating the disturbance into the standard evaluation data set, and the model robustness is evaluated by the attack test set. The experimental results show that the distilled small model can ensure the performance and improve the training speed under the condition of reducing the number of model parameters, and achieve the optimal effect on the attack test set, and the robustness is significantly improved. Code is available at https://github.com/Richard88888/KD-CGEC.


title: Neural Correlates of Face Familiarity Perception

abstract: In the domain of face recognition, there exists a puzzling timing discrepancy between results from macaque neurophysiology on the one hand and human electrophysiology on the other. Single unit recordings in macaques have demonstrated face identity specific responses in extra-striate visual cortex within 100 milliseconds of stimulus onset. In EEG and MEG experiments with humans, however, a consistent distinction between neural activity corresponding to unfamiliar and familiar faces has been reported to emerge around 250 ms. This points to the possibility that there may be a hitherto undiscovered early correlate of face familiarity perception in human electrophysiological traces. We report here a successful search for such a correlate in dense MEG recordings using pattern classification techniques. Our analyses reveal markers of face familiarity as early as 85 ms after stimulus onset. Low-level attributes of the images, such as luminance and color distributions, are unable to account for this early emerging response difference. These results help reconcile human and macaque data, and provide clues regarding neural mechanisms underlying familiar face perception.


title: Statistical Methods for Selective Biomarker Testing

abstract: Biomarker is a critically important tool in modern clinical diagnosis, prognosis, and classification/prediction. However, there are fiscal and analytical barriers to biomarker research. Selective Genotyping is an approach to increasing study power and efficiency where individuals with the most extreme phenotype (response) are chosen for genotyping (exposure) in order to maximize the information in the sample. In this article, we describe an analogous procedure in the biomarker testing landscape where both response and biomarker (exposure) are continuous. We propose an intuitive reverse-regression least squares estimator for the parameters relating biomarker value to response. Monte Carlo simulations show that this method is unbiased and efficient relative to estimates from random sampling when the joint normal distribution assumption is met. We illustrate application of proposed methods on data from a chronic pain clinical trial.


title: Generalized truncated moment problems with unbounded sets

abstract: This paper studies generalized truncated moment problems with unbounded sets. First, we study geometric properties of the truncated moment cone and its dual cone of nonnegative polynomials. By the technique of homogenization, we give a convergent hierarchy of Moment-SOS relaxations for approximating these cones. With them, we give a Moment-SOS method for solving generalized truncated moment problems with unbounded sets. Finitely atomic representing measures, or certificates for their nonexistence, can be obtained by the proposed method. Numerical experiments and applications are also given.


title: Basis light-front quantization approach to $\Lambda$ and $\Lambda_c$ and their isospin triplet baryons

abstract: We obtain the masses, the electromagnetic properties, and the parton distribution functions (PDFs) of $\Lambda$, $\Lambda_c$, and their isospin triplet baryons, i.e, $\Sigma^0$, $\Sigma^+$, $\Sigma^-$ and $\Sigma_c^0$, $\Sigma_c^+$, $\Sigma_c^{++}$ from a light-front effective Hamiltonian in the leading Fock sector in the basis light-front quantization framework. The light-front wave functions of these baryons are given by the eigenstates of the effective Hamiltonian consisting of a three-dimensional confinement potential and a one-gluon exchange interaction with fixed coupling. The masses of these baryons in our approach are in the experimental range while isospin-dependent mass differences are too small. Meanwhile, the electromagnetic properties are in agreement with the available experimental data, the lattice QCD simulations, and the other theoretical calculations. We also present the gluon and the sea quark PDFs, which we generate dynamically from the QCD evolution of the valence quark distributions.


title: Decentralized Intermittent Feedback Adaptive Control of Non-triangular Nonlinear Time-varying Systems

abstract: This paper investigates the decentralized stabilization problem for a class of interconnected systems in the presence of non-triangular structural uncertainties and time-varying parameters, where each subsystem exchanges information only with its neighbors and only intermittent (rather than continuous) states and input are to be utilized. Thus far to our best knowledge, no solution exists priori to this work, despite its high prevalence in practice. Two globally decentralized adaptive control schemes are presented based on the backstepping technique, the first one is developed in a continuous fashion by combining the philosophy of the modified congelation of variables based approach with the special treatment of non-triangular structural uncertainties, which avoids the derivative of time-varying parameters and eliminates the limitation of the triangular condition, thus largely broadens the scope of application. By making use of the important property that the partial derivatives of the constructed virtual controllers in each subsystem are all constant, the second scheme is developed through directly replacing the states in the preceding scheme with the triggered ones. Consequently, the non-differentiability of the virtual control stemming from intermittent state feedback is completely obviated. The internal signals under both schemes are rigorously shown to be globally uniformly bounded with the aid of several novel lemmas, while the stabilization performance can be enhanced by appropriately adjusting design parameters. Moreover, the inter-event intervals are ensured to be lower-bounded by a positive constant. Finally, numerical simulation verifies the benefits and efficiency of the proposed method.


title: Algebraic Degrees of Generalized Nash Equilibrium Problems

abstract: This paper studies algebraic degree of generalized Nash equilibrium problems (GNEPs) given by polynomials. Their generalized Nash equilibria (GNEs), as well as their KKT or Fritz-John points, are algebraic functions in the coefficients of defining polynomials. We study the degrees of these algebraic functions, which also counts the numbers of complex KKT or Fritz-John points. Under some genericity assumptions, we show that a GNEP has only finitely many complex Fritz-John points and every Fritz-John point is a KKT point. We also give formulae for algebraic degrees of GNEPs, which count the numbers of complex Fritz-John points for generic cases.


title: Age of View: A New Metric for Evaluating Heterogeneous Information Fusion in Vehicular Cyber-Physical Systems

abstract: Heterogeneous information fusion is one of the most critical issues for realizing vehicular cyber-physical systems (VCPSs). This work makes the first attempt at quantitatively measuring the quality of heterogeneous information fusion in VCPS by designing a new metric called Age of View (AoV). Specifically, we derive a sensing model based on a multi-class M/G/1 priority queue and a transmission model based on Shannon theory. On this basis, we formally define AoV by modeling the timeliness, completeness, and consistency of the heterogeneous information fusion in VCPS and formulate the problem aiming to minimize the system's average AoV. Further, we propose a new solution called Multi-agent Difference-Reward-based deep reinforcement learning with a Greedy Bandwidth Allocation (MDR-GBA) to solve the problem. In particular, each vehicle acts as an independent agent and decides the sensing frequencies and uploading priorities of heterogeneous information. Meanwhile, the roadside unit (RSU) decides the Vehicle-to-Infrastructure (V2I) bandwidth allocation for each vehicle based on a greedy scheme. Finally, we build the simulation model and compare the performance of the proposed solution with state-of-the-art algorithms. The experimental results conclusively demonstrate the significance of the new metric and the superiority of the proposed solution.


title: A Dynamical Analogue of the Criterion of N\'eron-Ogg-Shafarevich

abstract: We introduce an anabelian approach to the study of arboreal Galois representations and apply Tamagawa's anabelian version of the N\'eron-Ogg-Shafarevich criterion to produce a dynamical analogue of this criterion: unramified representations correspond to rational maps satisfying a strong form of good reduction in terms of their critical locus. Subsequently, we pursue a dynamical anlaogue of the N\'eron-Ogg-Shafarevich criterion in terms of the more (dynamically) traditional arboreal representations, which relates unramified arboreal representations to a certain separability condition on the dynamical system. Finally, we relate the our criteria: the anabelian criterion corresponds to the dynamical criterion as one varies the base point around the critical locus. Along the way we develop effective criteria to determine which primes are infinitely ramified in arboreal representations over number fields, as well as the asymptotic growth of that ramification; we conclude with examples and applications, especially to dynamical systems over number fields.


title: A comparative study of auxiliary intercalating agents on thermal conductivity of expanded graphite/polyetherimide composite

abstract: In this work, we have comprehensively studied the effect of auxiliary intercalating agents on the thermal conductivity of expanded graphite (EG) polymer composites. We report an ultra-high enhancement of 4030% in thermal conductivity of polyetherimide/graphene nanocomposite (k = 9.5 Wm-1K-1) prepared through the use of EG with hydrogen peroxide (H2O2) as an auxiliary intercalating agent at 10 wt% compositions (k of pure polyetherimide ~ 0.23 Wm-1K-1). This ultra-high thermal conductivity value is found to be due to an EG-mediated interconnected graphene network throughout the composite, establishing a percolative environment that enables highly efficient thermal transport in the composite. Comparative studies were also performed using sodium chlorate (NaClO3) as an auxiliary intercalating agent. At 10 wt% composition, NaClO3 intercalated EG was found to lead to a smaller enhancement of 2190% in k of composite. Detailed characterization performed to elucidate this advantage, revealed that hydrogen peroxide led to primarily edge oxidation of graphene sheets within EG, leaving the basal plane intact, thus preserving the ultra-high in-plane thermal conductivity of ~ 2000 Wm-1K-1. Sodium chlorate, on the other hand, led to a higher degree of oxidation, with a large number of oxygen groups on the basal plane of graphene, dramatically lowering its in-plane thermal conductivity. Thermal diffusivity of H2O2 prepared EG paper was measured to be 9.5 mm2/s while that of NaClO3 case was measured to be 6.7 mm2/s, thus directly confirming the beneficial impact of H2O2 on k of graphene itself. This study is the first to address the role of intercalating agents on k of expanded graphite/polymer composites and has led to the discovery of H2O2 as an effective intercalating agent for achieving ultra-high thermal conductivity values.


title: One for All: One-stage Referring Expression Comprehension with Dynamic Reasoning

abstract: Referring Expression Comprehension (REC) is one of the most important tasks in visual reasoning that requires a model to detect the target object referred by a natural language expression. Among the proposed pipelines, the one-stage Referring Expression Comprehension (OSREC) has become the dominant trend since it merges the region proposal and selection stages. Many state-of-the-art OSREC models adopt a multi-hop reasoning strategy because a sequence of objects is frequently mentioned in a single expression which needs multi-hop reasoning to analyze the semantic relation. However, one unsolved issue of these models is that the number of reasoning steps needs to be pre-defined and fixed before inference, ignoring the varying complexity of expressions. In this paper, we propose a Dynamic Multi-step Reasoning Network, which allows the reasoning steps to be dynamically adjusted based on the reasoning state and expression complexity. Specifically, we adopt a Transformer module to memorize & process the reasoning state and a Reinforcement Learning strategy to dynamically infer the reasoning steps. The work achieves the state-of-the-art performance or significant improvements on several REC datasets, ranging from RefCOCO (+, g) with short expressions, to Ref-Reasoning, a dataset with long and complex compositional expressions.


title: Photometric Analysis of Three Potential Red Nova Progenitors

abstract: We present photometric analysis of three bright red nova progenitor contact binary systems: ASAS J082151-0612.6, TYC 7281-269-1 and TYC 7275-1968-1. The primary components in all three systems are solar-type low mass stars with radii somewhat larger than their Zero Age Main Sequence counterparts. The secondaries, as in most contact binary systems, have radii and luminosities well above their main sequence counterparts. All three have extreme low mass ratios ranging from 0.075 to 0.097 and two have high degrees of contact, in excess of 75%. All three have mass ratios and separations below the theoretical values for orbital stability. Chromospheric activity, a hallmark of magnetic activity and magnetic braking, considered important in mediating angular momentum loss, is also explored. All three systems demonstrate the O'Connell effect, and all systems require the introduction of star spots for a better light curve solution. In addition, we show that ASAS J082151-0612.6 and TYC 7281-269-1 have a UV colour excess in the range indicating high chromospheric activity. Another measure of potential significant magnetic activity is X-Ray luminosity; TYC 7275-1968-1, and probably also TYC 7281-269-1, have X-Ray luminosity well above other contact binary systems. We conclude that it is likely that all three are unstable and hence are potential merger candidates.


title: Effect of the electrical double layer on the electrical conductivity of suspensions

abstract: We study the role of the electrical double layer (EDL) in the formation of the quasistatic electrical conductivity of suspensions of nanosized particles. A suspension is viewed as a system of hard-core--penetrable-shell particles. The shells are electrically inhomogeneous, with a radially symmetrical conductivity profile. It is assumed that the real microstructure of the suspension can be reflected in terms of this profile and also the rule of dominance for overlapping regions that the local conductivity in the system is determined by the nearest particle. Using our earlier rigorous results for systems with this morphology, we derive general integral relations for the desired conductivity which incorporate the effect of the EDL and make it possible to look into the contributions from its different parts and parameters. Specific features, internal consistency, and flexibility of the model are demonstrated by further elaborating it to describe experimental data for latex suspensions in aqueous electrolyte solutions with high ionic strength.


title: NFT Hydroponic Control Using Mamdani Fuzzy Inference System

abstract: The Nutrient Film Technique (NFT) method is one of the most popular hydroponic cultivation methods. This method has advantages such as easier maintenance, faster and optimal plant growth, better use of fertilizers, and less deposition. The disadvantages of NFT include the consumption of electrical power and the faster spread of disease. Therefore, NFT requires a good nutrient control and monitoring system to save electricity and achieve optimal growth and resistance to pests and diseases. In this study, a nutrient control was designed with indicators of pH and TDS levels and equipped with an Internet of Things (IoT) based monitoring system. The control system used is the Mamdani Fuzzy Inference System. The output of the system is the active time of the pH Up, pH Down, and AB Mix nutrient pumps, which aim to normalize the pH and TDS of nutrient liquids. The experimental results show that one to three control steps are needed to normalize pH. One control step has a response time of 60 seconds, and it can prevent pH Up and pH Down oscillations. As for TDS control, the prediction of AB mix pump active time works accurately, and TDS levels can be normalized in one control step. Overall, based on surface control, simulations, and real experimental data, it is indicated that the control system operates very well and can normalize pH and TDS to the desired normal standard.


title: Quantum Error Correction: Noise-adapted Techniques and Applications

abstract: The quantum computing devices of today have tens to hundreds of qubits that are highly susceptible to noise due to unwanted interactions with their environment. The theory of quantum error correction provides a scheme by which the effects of such noise on quantum states can be mitigated, paving the way for realising robust, scalable quantum computers. In this article we survey the current landscape of quantum error correcting (QEC) codes, focusing on recent theoretical advances in the domain of noise-adapted QEC, and highlighting some key open questions. We also discuss the interesting connections that have emerged between such adaptive QEC techniques and fundamental physics, especially in the areas of many-body physics and cosmology. We conclude with a brief review of the theory of quantum fault tolerance which gives a quantitative estimate of the physical noise threshold below which error-resilient quantum computation is possible.


title: Asymptotic repetitive threshold of balanced sequences

abstract: The critical exponent $E(\mathbf u)$ of an infinite sequence $\mathbf u$ over a finite alphabet expresses the maximal repetition of a factor in $\mathbf u$. By the famous Dejean's theorem, $E(\mathbf u) \geq 1+\frac1{d-1}$ for every $d$-ary sequence $\mathbf u$. We define the asymptotic critical exponent $E^*(\mathbf u)$ as the upper limit of the maximal repetition of factors of length $n$. We show that for any $d>1$ there exists a $d$-ary sequence $\mathbf u$ having $E^*(\mathbf u)$ arbitrarily close to $1$. Then we focus on the class of $d$-ary balanced sequences. In this class, the values $E^*(\mathbf u)$ are bounded from below by a threshold strictly bigger than 1. We provide a method which enables us to find a $d$-ary balanced sequence with the least asymptotic critical exponent for $2\leq d\leq 10$.


title: Evidence of anomalous Curie constants for nonmagnetic impurities in a critical 2-dimensional $JQ_3$ model on the honeycomb lattice

abstract: The Curie constants $C^{*} = \lim_{T\rightarrow 0}T\chi_{\text{imp}}$ of a spin-1/2 and a spin-1 impurities are calculated using the quantum Monte Carlo simulations. Here the impurity susceptibility $\chi_{\text{imp}}$ is the difference between the uniform susceptibilities with and without the impurity and $T$ is the temperature. Moreover, the two-dimensional quantum $JQ_3$ model on the honeycomb lattice is considered as the host system. $T\chi_{\text{imp}}$ as a function $T$ is investigated in great detail. Remarkably, our data indicate strongly that $C^* > 0.25$ and $C^* > 2/3$ for the spin-1/2 and the spin-1 impurities, respectively. In particular, although no definite conclusion is obtained due to finite-size effects, we find the Curie constant associated with a spin-1/2 impurity likely converges to a value greater than the established result of 0.262(2) in the literature. The outcomes reached here provide certain evidence that fractional impurity spin is observed for the studied $JQ_3$ system.


title: Skeleton-Parted Graph Scattering Networks for 3D Human Motion Prediction

abstract: Graph convolutional network based methods that model the body-joints' relations, have recently shown great promise in 3D skeleton-based human motion prediction. However, these methods have two critical issues: first, deep graph convolutions filter features within only limited graph spectrums, losing sufficient information in the full band; second, using a single graph to model the whole body underestimates the diverse patterns on various body-parts. To address the first issue, we propose adaptive graph scattering, which leverages multiple trainable band-pass graph filters to decompose pose features into richer graph spectrum bands. To address the second issue, body-parts are modeled separately to learn diverse dynamics, which enables finer feature extraction along the spatial dimensions. Integrating the above two designs, we propose a novel skeleton-parted graph scattering network (SPGSN). The cores of the model are cascaded multi-part graph scattering blocks (MPGSBs), building adaptive graph scattering on diverse body-parts, as well as fusing the decomposed features based on the inferred spectrum importance and body-part interactions. Extensive experiments have shown that SPGSN outperforms state-of-the-art methods by remarkable margins of 13.8%, 9.3% and 2.7% in terms of 3D mean per joint position error (MPJPE) on Human3.6M, CMU Mocap and 3DPW datasets, respectively.


title: Exploring Attention-Aware Network Resource Allocation for Customized Metaverse Services

abstract: Emerging with the support of computing and communications technologies, Metaverse is expected to bring users unprecedented service experiences. However, the increase in the number of Metaverse users places a heavy demand on network resources, especially for Metaverse services that are based on graphical extended reality and require rendering a plethora of virtual objects. To make efficient use of network resources and improve the Quality-of-Experience (QoE), we design an attention-aware network resource allocation scheme to achieve customized Metaverse services. The aim is to allocate more network resources to virtual objects in which users are more interested. We first discuss several key techniques related to Metaverse services, including QoE analysis, eye-tracking, and remote rendering. We then review existing datasets and propose the user-object-attention level (UOAL) dataset that contains the ground truth attention of 30 users to 96 objects in 1,000 images. A tutorial on how to use UOAL is presented. With the help of UOAL, we propose an attention-aware network resource allocation algorithm that has two steps, i.e., attention prediction and QoE maximization. Specially, we provide an overview of the designs of two types of attention prediction methods, i.e., interest-aware and time-aware prediction. By using the predicted user-object-attention values, network resources such as the rendering capacity of edge devices can be allocated optimally to maximize the QoE. Finally, we propose promising research directions related to Metaverse services.


title: Effects of dilute coal char particle suspensions on propagating methane detonation wave

abstract: Methane/coal dust hybrid explosion is one of the common hazards in process and mining industries. In this study, methane detonation propagation in dilute coal char particle suspensions is studied based on Eulerian-Lagrangian method. The effects of char combustion on methane detonation dynamics are focused on. The results show that propagation of the methane detonation wave in coal particle suspensions are considerably affected by particle concentration and size. Detonation extinction occurs when the coal particle size is small and concentration is high. The averaged lead shock speed generally decreases with increased particle concentration and decreased particle size. Mean structure and interphase coupling of hybrid detonation are analysed, based on the gas and particle quantities. It is found that char combustion proceeds in the subsonic region behind the detonation wave and heat release is relatively distributed compared to that from gas phase reaction. The mass and energy transfer rates increase rapidly to the maximum near the reaction front in the induction zone. Moreover, for 1 {\mu}m particles, if the particle concentration is beyond a threshold value, detonation re-initiation occurs after it is quenched at the beginning of the coal dust suspensions. This is caused by hot spots from the shock focusing along the reaction front in a decoupled detonation and these shocks are generated from char combustion behind the lead shock.


title: Nested Cover-Free Families for Unbounded Fault-Tolerant Aggregate Signatures

abstract: Aggregate signatures are used to create one short proof of authenticity and integrity from a set of digital signatures. However, one invalid signature in the set invalidates the entire aggregate, giving no information on which signatures are valid. Hartung et al. (2016) propose a fault-tolerant aggregate signature scheme based on combinatorial group testing. Given a bound $d$ on the number of invalid signatures among $n$ signatures to be aggregated, this scheme uses $d$-cover-free families to determine which signatures are invalid. These combinatorial structures guarantee a moderate increase on the size of the aggregate signature that can reach the best possible compression ratio of $O(\frac{n}{\log n})$, for fixed $d$, coming from an information theoretical bound. The case where the total number of signatures grows dynamically (unbounded scheme) was not satisfactorily solved in their original paper, since explicit constructions had constant compression ratios. In the present paper, we propose efficient solutions for the unbounded scheme, relying on sequences of $d$-cover-free families that we call {\em nested families}. Some of our constructions yield high compression ratio close to \rmv{the information theoretical bound}\todo{the best known upper bound}. We also propose the use of $(d,\lambda)$-cover-free families to support the loss of up to $\lambda-1$ parts of the aggregate.


title: A Local-Ratio-Based Power Control Approach for Capacitated Access Points in Mobile Edge Computing

abstract: Terminal devices (TDs) connect to networks through access points (APs) integrated into the edge server. This provides a prerequisite for TDs to upload tasks to cloud data centers or offload them to edge servers for execution. In this process, signal coverage, data transmission, and task execution consume energy, and the energy consumption of signal coverage increases sharply as the radius increases. Lower power leads to less energy consumption in a given time segment. Thus, power control for APs is essential for reducing energy consumption. Our objective is to determine the power assignment for each AP with same capacity constraints such that all TDs are covered, and the total power is minimized. We define this problem as a \emph{minimum power capacitated cover } (MPCC) problem and present a \emph{minimum local ratio} (MLR) power control approach for this problem to obtain accurate results in polynomial time. Power assignments are chosen in a sequence of rounds. In each round, we choose the power assignment that minimizes the ratio of its power to the number of currently uncovered TDs it contains. In the event of a tie, we pick an arbitrary power assignment that achieves the minimum ratio. We continue choosing power assignments until all TDs are covered. Finally, various experiments verify that this method can outperform another greedy-based way.


title: Modification tolerant signature schemes: location and correction

abstract: This paper considers malleable digital signatures, for situations where data is modified after it is signed. They can be used in applications where either the data can be modified (collaborative work), or the data must be modified (redactable and content extraction signatures) or we need to know which parts of the data have been modified (data forensics). A \new{classical} digital signature is valid for a message only if the signature is authentic and not even one bit of the message has been modified. We propose a general framework of modification tolerant signature schemes (MTSS), which can provide either location only or both location and correction, for modifications in a signed message divided into $n$ blocks. This general scheme uses a set of allowed modifications that must be specified. We present an instantiation of MTSS with a tolerance level of $d$, indicating modifications can appear in any set of up to $d$ message blocks. This tolerance level $d$ is needed in practice for parametrizing and controlling the growth of the signature size with respect to the number $n$ of blocks; using combinatorial group testing (CGT) the signature has size $O(d^2 \log n)$ which is close to the \new{best known} lower bound \new{of $\Omega(\frac{d^2}{\log d} (\log n))$}. There has been work in this very same direction using CGT by Goodrich et al. (ACNS 2005) and Idalino et al. (IPL 2015). Our work differs from theirs in that in one scheme we extend these ideas to include corrections of modification with provable security, and in another variation of the scheme we go in the opposite direction and guarantee privacy for redactable signatures, in this case preventing any leakage of redacted information.


title: Neuro-Symbolic Learning: Principles and Applications in Ophthalmology

abstract: Neural networks have been rapidly expanding in recent years, with novel strategies and applications. However, challenges such as interpretability, explainability, robustness, safety, trust, and sensibility remain unsolved in neural network technologies, despite the fact that they will unavoidably be addressed for critical applications. Attempts have been made to overcome the challenges in neural network computing by representing and embedding domain knowledge in terms of symbolic representations. Thus, the neuro-symbolic learning (NeSyL) notion emerged, which incorporates aspects of symbolic representation and bringing common sense into neural networks (NeSyL). In domains where interpretability, reasoning, and explainability are crucial, such as video and image captioning, question-answering and reasoning, health informatics, and genomics, NeSyL has shown promising outcomes. This review presents a comprehensive survey on the state-of-the-art NeSyL approaches, their principles, advances in machine and deep learning algorithms, applications such as opthalmology, and most importantly, future perspectives of this emerging field.


title: Cosmological contribution from population III stars in ultracompact minihalos

abstract: In this work, we investigate the effect of Population~III~(Pop.~III) stars in ultracompact minihalos~(UCMHs) on the cosmic ionization history using the Planck observation data. Although high-redshift astrophysics is not understood yet, UCMHs could host the Pop.~III stars like the halos formed in the standard structure formation scenario. Such Pop.~III stars would emit ionizing photons during their main sequence and facilitate cosmic reionization in high redshifts. To study their effects on the global ionization, we model the cosmic reionization evolution based on the ``tanh"-type reionization model which is expressed by $z_{\mathrm{reio}}$ with additional two parameters characterizing the initial mass of UCMHs and the number density of UCMHs. We implement the Monte Carlo Markov Chain analysis with the latest Planck observation data for our reionization model. As the result, we found that if the UCMH initial mass is larger than $10^{8.4}\mathrm{M}_{\odot}$, the number density of UCMHs is strictly limited. Then we obtained the constraint on the amplitude of the primordial power spectrum through the constraint on the UCMH number density like $\mathcal{A}_{\zeta}\lesssim 10^{-8}$ in the scales, $k\lesssim 50\mathrm{Mpc}^{-1}$, when we assume that the standard ``tanh"-type reionization occurs by $z=3$, so that we set $z_{\mathrm{reio}}>3$.


title: Using Chatbots to Teach Languages

abstract: This paper reports on progress towards building an online language learning tool to provide learners with conversational experience by using dialog systems as conversation practice partners. Our system can adapt to users' language proficiency on the fly. We also provide automatic grammar error feedback to help users learn from their mistakes. According to our first adopters, our system is entertaining and useful. Furthermore, we will provide the learning technology community a large-scale conversation dataset on language learning and grammar correction. Our next step is to make our system more adaptive to user profile information by using reinforcement learning algorithms.


title: Last performances improvement of the C-RED One camera using the 320x256 e-APD infrared Saphira detector

abstract: We present here the latest results obtained with the C-RED One camera developed by First Light Imaging for fast ultra-low noise infrared applications. This camera uses the Leonardo Saphira e-APD 320x256 infrared sensor in an autonomous cryogenic environment with a low vibration pulse tube and with embedded readout electronics system. Some recent improvements were made to the camera. The first important one concerns the total noise of the camera. Limited to 1.75 microns wavelength cut-off with proper cold filters, looking at a blackbody at room temperature and f/4 beam aperture, we now measure total noise down to 0.6 e at gain 50 in CDS mode 1720 FPS, dividing previous noise figure by a factor 2. The total camera background of 30-400 e/s is now achieved with a factor 3 of background reduction, the camera also looking at a room temperature blackbody with an F/4 beam aperture. Image bias oscillations, due to electronics grounding scheme, were carefully analyzed and removed. Focal plane detector vibrations transmitted by the pulse tube cooling machine were also analyzed, damped and measured down to 0.3 microns RMS, reducing focal plane vibrations by a factor 3. In addition, a vacuum getter of higher capacity is now used to offer camera operation without camera pumping during months. The camera main characteristics are detailed: pulse tube cooling at 80K with limited vibrations, permanent vacuum solution, ultra-low latency Cameralink full data interface, safety management of the camera by firmware, online firmware update, ambient liquid cooling and reduced weight of 20 kg.


title: On local representation densities of hermitian forms and special cycles II

abstract: In this paper, we prove that there are certain relations among representation densities and provide an efficient way to compute representation densities by using these relations. As an application, we compute some arithmetic intersection numbers of special cycles on unitary Shimura varieties and propose a conjecture on these.


title: Disagreement and fragmentation in growing groups

abstract: The arise of disagreement is an emergent phenomenon that can be observed within a growing social group and, beyond a certain threshold, can lead to group fragmentation. To better understand how disagreement emerges, we introduce an analytically tractable model of group formation where individuals have multidimensional binary opinions and the group grows through a noisy homophily principle, i.e., like-minded individuals attract each other with exceptions occurring with some small probability. Assuming that the level of disagreement is correlated with the number of different opinions coexisting within the group, we find analytically and numerically that in growing groups disagreement emerges spontaneously regardless of how small the noise in the system is. Moreover, for groups of infinite size, fragmentation is inevitable. We also show that the model outcomes are robust under different group growth mechanisms.


title: Less is More: Consistent Video Depth Estimation with Masked Frames Modeling

abstract: Temporal consistency is the key challenge of video depth estimation. Previous works are based on additional optical flow or camera poses, which is time-consuming. By contrast, we derive consistency with less information. Since videos inherently exist with heavy temporal redundancy, a missing frame could be recovered from neighboring ones. Inspired by this, we propose the frame masking network (FMNet), a spatial-temporal transformer network predicting the depth of masked frames based on their neighboring frames. By reconstructing masked temporal features, the FMNet can learn intrinsic inter-frame correlations, which leads to consistency. Compared with prior arts, experimental results demonstrate that our approach achieves comparable spatial accuracy and higher temporal consistency without any additional information. Our work provides a new perspective on consistent video depth estimation. Our official project page is https://github.com/RaymondWang987/FMNet.


title: Sub-electron noise infrared camera development using Leonardo large format 2Kx2K SWIR LmAPD array

abstract: There have been no significant breakthroughs in infrared imagery since the hybridization of III-V or II-VI narrow-bandgap semiconductors on complementary metal-oxide semiconductor (CMOS) read-out integrated circuits (ROICs). The development of third-generation, linear-mode avalanche photodiode arrays (LmAPDs) using mercury cadmium telluride (MCT) has resulted in a significant sensitivity improvement for short-wave infrared (SWIR) imaging. The first dedicated LmAPD device, called SAPHIRA (320x256/24 microns), was designed by Leonardo UK Ltd specifically for SWIR astronomical applications. In the past decade there has been a significant development effort to make larger LmAPD arrays for low-background astronomy. Larger LmAPD formats for ultra-low noise/flux SWIR imaging, currently under development at Leonardo include a 512 x 512 LmAPD array funded by ESO, MPE and NRC Herzberg, a 1k x 1k array funded by NASA and a 2K x 2K device funded by ESA for general scientific imaging applications. The 2048x2048 pixel ROIC has a pitch of 15 microns, 4/8/16 outputs and a maximum frame rate of 10 Hz. The ROIC characterization is scheduled in the third quarter of 2022, while the first arrays will be fabricated by end-2022. The hybridized arrays will be characterized during end-2022. At this time, First Light Imaging will start the development of an autonomous camera integrating this 2Kx2K LmAPD array, based on the unique experience from the C-RED One camera, the only commercial camera integrating the SAPHIRA SWIR LmAPD array.The detector will be embedded in a compact high vacuum cryostat cooled with low vibration pulse at 50-80K which does not require external pumping. Sub-electron readout noise is expected to be achieved with high multiplication gain. Custom cold filters and beam aperture cold baffling will be integrated in the camera.


title: Possible coexistence of short-range resonating-valence-bond and long-range stripe correlations in the spatially anisotropic triangular-lattice quantum magnet Cu$_2$(OH)$_3$NO$_3$

abstract: We show that short-range resonating-valence-bond correlations and long-range order can coexist in the ground state (GS) of a frustrated spin system. Our study comprises a comprehensive investigation of the quantum magnetism on the structurally disorder-free single crystal of Cu$_2$(OH)$_3$NO$_3$, which realizes the $s$ = 1/2 Heisenberg model on a spatially anisotropic triangular lattice. Competing exchange interactions determined by fitting the magnetization measured up to 55 T give rise to an exotic GS wavefunction with coexistence of the dominant short-range resonating-valence-bond correlations and weak long-range stripe order (ordered moment $M_0$ = $|\langle s_i^z\rangle|$ $\sim$ 0.02). At low temperatures, a first-order spin-flop transition is visible at $\sim$ 1-3 T. As the applied field further increases, another two magnetic-field-induced quantum phase transitions are observed at $\sim$ 14-19 and $\sim$ 46-52 T, respectively. Simulations of the Heisenberg exchange model show semi-quantitative agreement with the magnetic-field modulation of these unconventional phases, as well as the absence of visible magnetic reflections in neutron diffraction, thus supporting the GS of the spin system of Cu$_2$(OH)$_3$NO$_3$ may be approximate to a quantum spin liquid. Our study establishes structurally disorder-free magnetic materials with spatially anisotropic exchange interactions as a possible arena for spin liquids.


title: DRL-M4MR: An Intelligent Multicast Routing Approach Based on DQN Deep Reinforcement Learning in SDN

abstract: Traditional multicast routing methods have some problems in constructing a multicast tree, such as limited access to network state information, poor adaptability to dynamic and complex changes in the network, and inflexible data forwarding. To address these defects, the optimal multicast routing problem in software-defined networking (SDN) is tailored as a multi-objective optimization problem, and an intelligent multicast routing algorithm DRL-M4MR based on the deep Q network (DQN) deep reinforcement learning (DRL) method is designed to construct a multicast tree in SDN. First, the multicast tree state matrix, link bandwidth matrix, link delay matrix, and link packet loss rate matrix are designed as the state space of the DRL agent by combining the global view and control of the SDN. Second, the action space of the agent is all the links in the network, and the action selection strategy is designed to add the links to the current multicast tree under four cases. Third, single-step and final reward function forms are designed to guide the intelligence to make decisions to construct the optimal multicast tree. The experimental results show that, compared with existing algorithms, the multicast tree construct by DRL-M4MR can obtain better bandwidth, delay, and packet loss rate performance after training, and it can make more intelligent multicast routing decisions in a dynamic network environment.


title: Follow the Math!: The mathematics of quantum mechanics as the mathematics of set partitions linearized to (Hilbert) vector spaces

abstract: The purpose of this paper is to show that the mathematics of quantum mechanics (QM) is the mathematics of set partitions (which specify indefiniteness and definiteness) linearized to vector spaces, particularly in Hilbert spaces. That is, the math of QM is the Hilbert space version of the math to describe objective indefiniteness that at the set level is the math of partitions. The key analytical concepts are definiteness versus indefiniteness, distinctions versus indistinctions, and distinguishability versus indistinguishability. The key machinery to go from indefinite to more definite states is the partition join operation at the set level that prefigures at the quantum level projective measurement as well as the formation of maximally-definite state descriptions by Dirac's Complete Sets of Commuting Operators (CSCOs). This development is measured quantitatively by logical entropy at the set level and by quantum logical entropy at the quantum level. This follow-the-math approach supports the Literal Interpretation of QM--as advocated by Abner Shimony among others which sees a reality of objective indefiniteness that is quite different from the common sense and classical view of reality as being "definite all the way down."


title: Evaluating Table Structure Recognition: A New Perspective

abstract: Existing metrics used to evaluate table structure recognition algorithms have shortcomings with regard to capturing text and empty cells alignment. In this paper, we build on prior work and propose a new metric - TEDS based IOU similarity (TEDS (IOU)) for table structure recognition which uses bounding boxes instead of text while simultaneously being robust against the above disadvantages. We demonstrate the effectiveness of our metric against previous metrics through various examples.


title: Robotic Dough Shaping

abstract: Robotic manipulation of deformable objects gains great attention due to its wide applications including medical surgery, home assistance, and automatic food preparation. The ability to deform soft objects remains a great challenge for robots due to difficulties in defining the problem mathematically. In this paper, we address the problem of shaping a piece of dough-like deformable material into a 2D target shape presented upfront. We use a 6 degree-of-freedom WidowX-250 Robot Arm equipped with a rolling pin and information collected from an RGB-D camera and a tactile sensor. We present and compare several control policies, including a dough shrinking action, in extensive experiments across three kinds of deformable materials and across three target dough shape sizes, achieving the intersection over union (IoU) of 0.90. Our results show that: i) rolling dough from the highest dough point is more efficient than from the 2D/3D dough centroid; ii) it might be better to stop the roll movement at the current dough boundary as opposed to the target shape outline; iii) the shrink action might be beneficial only if properly tuned with respect to the expand action; and iv) the Play-Doh material is easier to shape to a target shape as compared to Plasticine or Kinetic sand. Video demonstrations of our work are available at https://youtu.be/ZzLMxuITdt4


title: Graphs, lattices and deconstruction hierarchies

abstract: The mathematics underlying the connection between deconstruction lattices and locality diagrams of conformal models is developed from scratch, with special emphasis on classification issues. In particular, the notions of equilocality classes, deflation map, essential vertices and stem graphs are introduced in order to characterize those graphs that may arise as locality diagrams.


title: Secure Email Transmission Protocols -- A New Architecture Design

abstract: During today's digital age, emails have become a crucial part of communications for both personal and enterprise usage. However, email transmission protocols were not designed with security in mind, and this has always been a challenge while trying to make email transmission more secure. On top of the basic layer of SMTP, POP3, and IMAP protocols to send and retrieve emails, there are several other major security protocols used in current days to secure email transmission such as TLS/SSL, STARTTLS, and PGP/GPG encryption. The most general design used in email transmission architecture is SMTP with PGP/GPG encryption sending through an TLS/SSL secure channel. Regardless, vulnerabilities within these security protocols and encryption methods, there is still work can be done regarding the architecture design. In this paper, we discuss the challenges among current email transmission security protocols and architectures. We explore some new techniques and propose a new email transmission architecture using EEKS structure and Schnorr Signature to eliminate the usage of PGP/GPG for encryption while achieving Perfect Forward Secrecy.


title: The finest locally convex topology of an extended locally convex space

abstract: Salas and Garcia introduced the concept of an extended locally convex space in [D. Salas and S. Tapia-Garcia. Extended seminorms and extended topological vector spaces. Topology and its Applications, 2016] which extends the idea of an extended normed space (introduced by Beer in G. Beer. Norms with infinite values. Journal of Convex Analysis, 2015). This article gives an attractive formulation of the finest locally convex topology of an extended locally convex space and provides a systematic study of the resulting locally convex space. As an application, we characterize the coincidence of the finest locally convex topologies corresponding to the topologies of uniform and strong uniform convergences on a bornology for the function space C(X).


title: Exploring interacting topological insulator of extended Su-Schrieffer-Heeger model

abstract: Exploring topological phases in interacting systems is a challenging task. We investigate many-body topological physics of interacting fermions in an extended Su-Schrieffer-Heeger (SSH) model, which extends the two sublattices of SSH model into four sublattices and thus is dubbed SSH4 model, based on the density-matrix renormalization-group numerical method. The interaction-driven phase transition from topological insulator to charge density wave (CDW) phase can be identified by analyzing the variations of entanglement spectrum, entanglement entropies, energy gaps, CDW order parameter, and fidelity. We map the global phase diagram of the many-body ground state, which contains nontrivial topological insulator, trivial insulator and CDW phases, respectively. In contrast to interacting SSH model, in which the phase transitions to the CDW phase are argued to be first-order phase transitions, the phase transitions between the CDW phase and topologically trivial/nontrivial phases are shown to be continuous phase transitions. Finally, we {also} show the phase diagram of interacting spinful SSH4 model, where the attractive (repulsive) on-site spin interaction amplifies (suppresses) the CDW phase. The models analyzed here can be implemented with ultracold atoms on optical superlattices.


title: An Experimental Study on Learning Correlated Equilibrium in Routing Games

abstract: We study route choice in a repeated routing game where an uncertain state of nature determines link latency functions, and agents receive private route recommendation. The state is sampled in an i.i.d. manner in every round from a publicly known distribution, and the recommendations are generated by a randomization policy whose mapping from the state is known publicly. In a one-shot setting, the agents are said to obey recommendation if it gives the smallest travel time in a posteriori expectation. A plausible extension to repeated setting is that the likelihood of following recommendation in a round is related to regret from previous rounds. If the regret is of satisficing type with respect to a default choice and is averaged over past rounds and over all agents, then the asymptotic outcome under an obedient recommendation policy coincides with the one-shot outcome. We report findings from an experiment with one participant at a time engaged in repeated route choice decision on computer. In every round, the participant is shown travel time distribution for each route, a route recommendation generated by an obedient policy, and a rating suggestive of average experience of previous participants with the quality of recommendation. Upon entering route choice, the actual travel times are revealed. The participant evaluates the quality of recommendation by submitting a review. This is combined with historical reviews to update rating for the next round. Data analysis from 33 participants each with 100 rounds suggests moderate negative correlation between the display rating and the average regret, and a strong positive correlation between the rating and the likelihood of following recommendation. Overall, under obedient recommendation policy, the rating converges close to its maximum value by the end of the experiments in conjunction with very high frequency of following recommendations.


title: PVBM: A Python Vasculature Biomarker Toolbox Based On Retinal Blood Vessel Segmentation

abstract: Introduction: Blood vessels can be non-invasively visualized from a digital fundus image (DFI). Several studies have shown an association between cardiovascular risk and vascular features obtained from DFI. Recent advances in computer vision and image segmentation enable automatising DFI blood vessel segmentation. There is a need for a resource that can automatically compute digital vasculature biomarkers (VBM) from these segmented DFI. Methods: In this paper, we introduce a Python Vasculature BioMarker toolbox, denoted PVBM. A total of 11 VBMs were implemented. In particular, we introduce new algorithmic methods to estimate tortuosity and branching angles. Using PVBM, and as a proof of usability, we analyze geometric vascular differences between glaucomatous patients and healthy controls. Results: We built a fully automated vasculature biomarker toolbox based on DFI segmentations and provided a proof of usability to characterize the vascular changes in glaucoma. For arterioles and venules, all biomarkers were significant and lower in glaucoma patients compared to healthy controls except for tortuosity, venular singularity length and venular branching angles. Conclusion: We have automated the computation of 11 VBMs from retinal blood vessel segmentation. The PVBM toolbox is made open source under a GNU GPL 3 license and is available on physiozoo.com (following publication).


title: Significance of the nature of disorder on the universal features of the spatio-temporal correlations of two-dimensional Coulomb-clusters

abstract: We comprehend the role of imperfections in materials consisting of interacting particles, arising from different origins on their universal features. Specifically, we report the static and dynamic responses in a cluster of Coulomb interacting particles in two dimensions. Confined systems with pinned impurities are studied, and results are compared with those from irregularly trapped system of particles. While the disorder of first type leads to diffusive single-particle dynamics, the motion of a single particle in an irregular trap is chaotic but ballistic. The many-particle system does not differentiate between these two models of disorder insofar as their qualitative properties are concerned -- particularly for describing the thermal melting of the underlying Coulomb-"solid". However, quantitative differences persist -- the relaxation time scales differ significantly by tuning impurity concentration.


title: STrajNet: Multi-modal Hierarchical Transformer for Occupancy Flow Field Prediction in Autonomous Driving

abstract: Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation to jointly predict surrounding agents' future motions in a scene. However, the challenging part is to model the underlying social interactions among traffic agents and the relations between occupancy and flow. Therefore, this paper proposes a novel Multi-modal Hierarchical Transformer network that fuses the vectorized (agent motion) and visual (scene flow, map, and occupancy) modalities and jointly predicts the flow and occupancy of the scene. Specifically, visual and vector features from sensory data are encoded through a multi-stage Transformer module and then a late-fusion Transformer module with temporal pixel-wise attention. Importantly, a flow-guided multi-head self-attention (FG-MSA) module is designed to better aggregate the information on occupancy and flow and model the mathematical relations between them. The proposed method is comprehensively validated on the Waymo Open Motion Dataset and compared against several state-of-the-art models. The results reveal that our model with much more compact architecture and data inputs than other methods can achieve comparable performance. We also demonstrate the effectiveness of incorporating vectorized agent motion features and the proposed FG-MSA module. Compared to the ablated model without the FG-MSA module, which won 2nd place in the 2022 Waymo Occupancy and Flow Prediction Challenge, the current model shows better separability for flow and occupancy and further performance improvements.


title: Radio fossils, relics, and haloes in Abell 3266: cluster archaeology with ASKAP-EMU and the ATCA

abstract: Abell 3266 is a massive and complex merging galaxy cluster that exhibits significant substructure. We present new, highly sensitive radio continuum observations of Abell 3266 performed with the Australian Square Kilometre Array Pathfinder (0.8$-$1.1 GHz) and the Australia Telescope Compact Array (1.1$-$3.1 GHz). These deep observations provide new insights into recently-reported diffuse non-thermal phenomena associated with the intracluster medium, including a 'wrong-way' relic, a fossil plasma source, and an as-yet unclassified central diffuse ridge, which we reveal comprises the brightest part of a large-scale radio halo detected here for the first time. The 'wrong-way' relic is highly atypical of its kind: it exhibits many classical signatures of a shock-related radio relic, while at the same time exhibiting strong spectral steepening. While radio relics are generally consistent with a quasi-stationary shock scenario, the 'wrong-way' relic is not. We study the spectral properties of the fossil plasma source; it exhibits an ultra-steep and highly curved radio spectrum, indicating an extremely aged electron population. The larger-scale radio halo fills much of the cluster centre, and presents a strong connection between the thermal and non-thermal components of the intracluster medium, along with evidence of substructure. Whether the central diffuse ridge is simply a brighter component of the halo, or a mini-halo, remains an open question. Finally, we study the morphological and spectral properties of the multiple complex radio galaxies in this cluster in unprecedented detail, tracing their evolutionary history.


title: Bayesian inference of the fluctuating proton shape in DIS and hadronic collisions

abstract: We determine the likelihood distribution for the model parameters describing the event-by-event fluctuating proton geometry at small $x$ by performing a Bayesian analysis within the Color Glass Condensate framework. The exclusive $\mathrm{J}/\psi$ production data from HERA is found to constrain the model parameters well, and we demonstrate that complementary constraints can be obtained from simulations of Pb+Pb collisions at the LHC.


title: Implications of New Quantum Spin Perspective In Quantum Gravity

abstract: Consequences of new quantum spin perspective in quantum gravity are far-reaching. Results of this novel perspective in loop quantum gravity, i.e., the modification of the equation of geometrical operators such as the area and the volume operator are known. Using newly proposed formula from this perspective, the magnitude of fundamental constants such as the reduced Planck constant \(\hbar\), the gravitational constant \(G\), the speed of light \(c\), the Boltzmann constant \(k_{\beta}\), the fine structure constant \(\alpha\), can be validated. With the aid of this perspective, we find new formulas for the fundamental Planckian quantities and the derived Planckian quantities. We also propose novel formulas for the Planck star such as the size, the curvature, the surface area and the size of black hole (for the Planck star) without modifying its significance. The relation of the quantum spin with the Planck temperature \(T_{P}\) \((T_{p} \propto n^{2})\), the Planck mass \(m_{P}\) \((m_{P} \propto n^{2})\), the Planck length \(l_{P}\) \((l_{P} \propto n)\) are also proposed using this novel perspective


title: Ultra-low Latency Adaptive Local Binary Spiking Neural Network with Accuracy Loss Estimator

abstract: Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights of SNNs has gradually attracted attention. Inspired by Artificial Neural Networks (ANNs) quantization technology, binarized SNN (BSNN) is introduced to solve the memory problem. Due to the lack of suitable learning algorithms, BSNN is usually obtained by ANN-to-SNN conversion, whose accuracy will be limited by the trained ANNs. In this paper, we propose an ultra-low latency adaptive local binary spiking neural network (ALBSNN) with accuracy loss estimators, which dynamically selects the network layers to be binarized to ensure the accuracy of the network by evaluating the error caused by the binarized weights during the network learning process. Experimental results show that this method can reduce storage space by more than 20 % without losing network accuracy. At the same time, in order to accelerate the training speed of the network, the global average pooling(GAP) layer is introduced to replace the fully connected layers by the combination of convolution and pooling, so that SNNs can use a small number of time steps to obtain better recognition accuracy. In the extreme case of using only one time step, we still can achieve 92.92 %, 91.63 % ,and 63.54 % testing accuracy on three different datasets, FashionMNIST, CIFAR-10, and CIFAR-100, respectively.


title: Neural Knowledge Bank for Pretrained Transformers

abstract: The ability of pretrained Transformers to remember factual knowledge is essential but still limited for existing models. Inspired by existing work that regards Feed-Forward Networks (FFNs) in Transformers as key-value memories, we design a Neural Knowledge Bank (NKB) and a knowledge injection strategy to introduce extra factual knowledge for pretrained Transformers. The NKB is in the form of additional knowledgeable memory slots to the FFN and the memory-like architecture makes it highly interpretable and flexible. When injecting extra knowledge with the Salient Span Masking (SSM) pretraining objective, we fix the original pretrained model and train only the NKB. This training strategy makes sure the general language modeling ability of the original pretrained model is not influenced. By mounting the NKB onto the T5 model, we verify its strong ability to store extra factual knowledge based on three closed-book question answering datasets. Also, we prove that mounting the NKB will not degrade the general language modeling ability of T5 through two representative tasks, summarization and machine translation. Further, we thoroughly analyze the interpretability of the NKB and reveal the meaning of its keys and values in a human-readable way. Finally, we show the flexibility of the NKB by directly modifying its value vectors to update the factual knowledge stored in it.


title: FixMatchSeg: Fixing FixMatch for Semi-Supervised Semantic Segmentation

abstract: Supervised deep learning methods for semantic medical image segmentation are getting increasingly popular in the past few years.However, in resource constrained settings, getting large number of annotated images is very difficult as it mostly requires experts, is expensive and time-consuming.Semi-supervised segmentation can be an attractive solution where a very few labeled images are used along with a large number of unlabeled ones. While the gap between supervised and semi-supervised methods have been dramatically reduced for classification problems in the past couple of years, there still remains a larger gap in segmentation methods. In this work, we adapt a state-of-the-art semi-supervised classification method FixMatch to semantic segmentation task, introducing FixMatchSeg. FixMatchSeg is evaluated in four different publicly available datasets of different anatomy and different modality: cardiac ultrasound, chest X-ray, retinal fundus image, and skin images. When there are few labels, we show that FixMatchSeg performs on par with strong supervised baselines.